-- Logs begin at Fri 2021-05-28 13:23:33 UTC, end at Fri 2021-05-28 14:49:14 UTC. --
May 28 14:12:42.672352 dv-cinder-791281-3-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
May 28 14:12:43.692435 dv-cinder-791281-3-iscsi neutron-server[92583]: Beware of the coming changes in the project packaging
May 28 14:12:43.693134 dv-cinder-791281-3-iscsi neutron-server[92583]: https://github.com/svinota/pyroute2/discussions/786
May 28 14:12:45.209212 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.common.config [-] Logging enabled!
May 28 14:12:45.209854 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev246
May 28 14:12:45.210002 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92583) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 28 14:12:45.213355 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.common.config [-] Logging enabled!
May 28 14:12:45.213613 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev246
May 28 14:12:45.213932 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92583) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 28 14:12:45.215450 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 28 14:12:45.215710 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 28 14:12:45.216079 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 28 14:12:45.216333 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 28 14:12:45.216583 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 28 14:12:45.216909 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.217213 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.217516 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.217751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.218048 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.218342 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.218629 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.219000 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.219246 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.219539 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.219850 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.220149 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.220384 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.220678 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.220968 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.221261 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.221489 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] debug                          = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.221798 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.222253 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.222673 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.222956 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.223253 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.223538 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.223836 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.224137 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.224430 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.224760 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] host                           = dv-cinder-791281-3-iscsi {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.225040 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.225333 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.225631 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.225921 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.226197 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.226610 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.226792 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.227068 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.227344 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.227643 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.227941 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.228235 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.228534 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.228762 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.228987 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.229299 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.229591 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.229871 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.230182 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.230462 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.231006 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.231286 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.231571 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.231864 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.232154 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.232445 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.232721 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.232998 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.233328 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.233592 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.233882 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.234157 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.234434 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.234710 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.234999 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.235270 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.235545 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.235871 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.236162 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.236470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.236761 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.237038 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.237327 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.237617 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.237897 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.238171 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.238446 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.238719 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.239004 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.239423 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.239599 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.239937 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.240158 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.240448 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:45.240750 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.241055 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.241361 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.241649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.241947 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.242230 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.242525 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.242833 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.243128 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.243422 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.243742 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.244047 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.244343 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.244626 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.244929 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.245241 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.245541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.245864 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.246143 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.246422 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.246699 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.246981 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.247269 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.247620 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.247919 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.248199 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.248483 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.248783 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.249067 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.249346 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.249635 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.249929 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.250217 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.250517 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.250810 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.251097 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.251375 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.251682 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.251967 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.252267 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.252551 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.252830 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.253108 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.253413 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.253693 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.253987 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.254271 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.254551 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.254921 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.255139 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.255418 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.255734 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.256021 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.256305 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.256604 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.256886 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.257167 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.257445 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.257722 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.257999 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.258273 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.258547 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.258901 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.259107 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.259395 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.259686 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.259967 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.260251 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.260544 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.260849 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.261134 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.261967 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.262417 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.262783 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.263115 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.263520 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.263953 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.264351 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.264707 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.265054 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.265455 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.265866 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.266161 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.266565 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.266983 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.267387 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.267867 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.268158 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.268447 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.268767 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.269062 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.269368 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.269693 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.269996 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.270303 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.270604 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.270906 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.271227 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.271513 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:45.271759 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 28 14:12:45.272023 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=92583) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
May 28 14:12:45.635499 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=92583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:12:45.635710 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=92583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:12:45.636011 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=92583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:12:45.637131 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.manager [-] Loading core plugin: ml2
May 28 14:12:46.045752 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.046065 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.046348 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.047572 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.047854 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.048125 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.084325 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.084607 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.084879 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.098118 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.098404 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.098678 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.129766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.130051 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.130324 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.167326 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.168192 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.168470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.404296 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fbba3ca6ee0> agent after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.404915 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fbba3ca6ee0> agent after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.404915 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7fbba3ca6e50> segment precommit_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.405080 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7fbba3ca6dc0> network precommit_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.405782 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7fbba3cca9d0> segment before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.531518 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> network before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.531866 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7fbba3bfc0d0> agent before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.532174 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> network before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.532465 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> port before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.532739 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> port before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.533058 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> segment precommit_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.533325 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> segment precommit_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.533587 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> segment after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.533846 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> segment after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.534133 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> network after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.534397 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> network precommit_delete 0 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.534669 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> port provisioning_complete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.534954 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.535272 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> rbac-policy after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.535574 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> agent after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.535860 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> subnet after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.537186 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> subnet precommit_delete 0 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.537498 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.537777 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.538083 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> segment_host_mapping after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.538453 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> port after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.538722 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> port after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.539007 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> port after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.539308 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.539587 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.539847 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fbba45a3e80>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.540245 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=92583) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 28 14:12:46.540497 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=92583) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 28 14:12:46.540746 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=92583) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 28 14:12:46.540991 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=92583) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 28 14:12:46.541253 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=92583) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 28 14:12:46.541494 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=92583) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 28 14:12:46.541899 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
May 28 14:12:46.545090 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
May 28 14:12:46.549079 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
May 28 14:12:46.552851 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(850, 899)])])
May 28 14:12:46.554514 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
May 28 14:12:46.555006 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
May 28 14:12:46.555363 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
May 28 14:12:46.555757 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
May 28 14:12:46.559261 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
May 28 14:12:46.559515 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
May 28 14:12:46.559892 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
May 28 14:12:46.587738 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
May 28 14:12:46.588198 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7fbba3d2d8b0>> qos_plugin after_init 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.588510 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=92583) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
May 28 14:12:46.588874 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7fbba3d2d4f0>> logging-plugin after_init 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.590878 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=92583) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
May 28 14:12:46.591163 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
May 28 14:12:46.591412 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
May 28 14:12:46.594676 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fbba3aca2e0>> floatingip before_response 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.594967 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fbba3aca2e0>> port before_response 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:46.663878 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
May 28 14:12:46.664057 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
May 28 14:12:46.664297 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
May 28 14:12:46.664692 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
May 28 14:12:46.695833 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_db.sqlalchemy.engines [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
May 28 14:12:47.238368 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Initializing driver for type 'gre'
May 28 14:12:47.238893 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] gre ID ranges: [(1, 1000)]
May 28 14:12:47.481321 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Initializing driver for type 'local'
May 28 14:12:47.481950 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Initializing driver for type 'vlan'
May 28 14:12:47.586644 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] VlanTypeDriver initialization complete
May 28 14:12:47.586903 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Initializing driver for type 'vxlan'
May 28 14:12:47.587413 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] vxlan ID ranges: [(1, 1000)]
May 28 14:12:47.855947 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Initializing extension driver 'port_security'
May 28 14:12:47.856337 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.extensions.port_security [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] PortSecurityExtensionDriver initialization complete
May 28 14:12:47.856695 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Initializing mechanism driver 'openvswitch'
May 28 14:12:47.856695 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Initializing mechanism driver 'hyperv'
May 28 14:12:47.863311 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.plugins.ml2.plugin [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=92583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:12:47.864096 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3b964f0>> port after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.864471 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3b964f0>> port after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.864824 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3b964f0>> port after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.865210 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3b96520>> subnet after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.865560 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3b96520>> subnet after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.865901 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3b96520>> subnet after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.866278 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625400>> network after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.866620 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625400>> network after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.866959 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625400>> network after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.867386 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625670>> security_group after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.867754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625670>> security_group after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.868072 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625670>> security_group after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.868450 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625910>> security_group_rule after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.868790 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625910>> security_group_rule after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.869127 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625910>> security_group_rule after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.869495 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625b80>> address_group after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.869836 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625b80>> address_group after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.870171 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fbba3625b80>> address_group after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.870999 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] ML2 OVO RPC backend initialized. {{(pid=92583) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
May 28 14:12:47.871746 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> router_interface after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.872102 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> router_interface after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.872519 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> network before_response 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.872863 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> networks before_response 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.873209 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> port before_response 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.873545 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> ports before_response 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.873883 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> subnet before_response 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.874220 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> subnets before_response 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.874596 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> network after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.874930 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> network after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.875258 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> network after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.875696 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> port after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.875985 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> port after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.876317 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> port after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.876649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> subnet after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.876981 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> subnet after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.882095 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fbba3625f70>> subnet after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.882095 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.plugin [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Modular L2 Plugin initialization complete
May 28 14:12:47.882095 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading services supported by the core plugin {{(pid=92583) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
May 28 14:12:47.882095 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.plugins.ml2.managers [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Got port-security extension from driver 'port_security'
May 28 14:12:47.882095 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.extensions.vlantransparent [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Disabled vlantransparent extension.
May 28 14:12:47.882095 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=92583) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
May 28 14:12:47.882095 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading Plugin: router
May 28 14:12:47.928802 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router_interface before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.929198 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router after_create 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.929563 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router before_create 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.929925 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router_interface before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.930293 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router_interface after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.930642 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router after_delete 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.930998 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> floatingip after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.931356 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router after_create 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.931735 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router after_update 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.932092 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router after_update 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.932439 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router_gateway after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.932795 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router after_update 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.933713 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router precommit_update 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.934127 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7fbba3c3c940> port after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.934464 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7fbba3c3ca60> port after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.934804 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7fbba3c3c9d0> subnet after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.935142 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7fbba3c3c820> subnetpool_address_scope after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.935488 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> port precommit_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.935864 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router precommit_create 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.936278 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7fbba3c33430> port before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.936629 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router precommit_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.936988 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router after_update 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.937329 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router precommit_delete 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.937676 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router precommit_create 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.938036 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router_interface after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.938379 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> router precommit_update 55549900 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.938750 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fbba3625700>> network after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.939648 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Tracking information for resource: router configured {{(pid=92583) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 28 14:12:47.939977 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Tracking information for resource: floatingip configured {{(pid=92583) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 28 14:12:47.944957 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.db.l3_agentschedulers_db [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
May 28 14:12:47.945546 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7fbba359ee50> port after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.945910 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7fbba359ed30> port after_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.946262 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function _notify_port_delete at 0x7fbba359edc0> port after_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.946615 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7fbba35a3160> port after_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.947421 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fbba35c7250>> router before_create 55550100 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.947910 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fbba35c7250>> router precommit_delete 55550100 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.948275 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fbba35c7250>> router precommit_create 55550100 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.948633 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fbba35c7250>> router precommit_update 55550100 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.953756 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.services.provider_configuration [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service providers = [] {{(pid=92583) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
May 28 14:12:47.954119 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.db.servicetype_db [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=92583) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
May 28 14:12:47.957149 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.services.service_base [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=92583) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 28 14:12:47.957491 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.services.service_base [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=92583) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 28 14:12:47.964526 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.services.service_base [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=92583) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 28 14:12:47.965176 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.services.service_base [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=92583) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 28 14:12:47.965549 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.services.service_base [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Default provider is not specified for service type L3_ROUTER_NAT
May 28 14:12:47.966096 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=92583) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 28 14:12:47.966418 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
May 28 14:12:47.976913 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=92583) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 28 14:12:47.977250 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading Plugin: auto_allocate
May 28 14:12:47.983388 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fbba35e9550> network precommit_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.983753 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fbba35e9550> network precommit_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:47.984278 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=92583) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 28 14:12:47.984610 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading Plugin: tag
May 28 14:12:47.991521 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=92583) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 28 14:12:47.991881 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading Plugin: timestamp
May 28 14:12:47.996318 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=92583) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 28 14:12:48.004151 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading Plugin: network_ip_availability
May 28 14:12:48.009359 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fbba35dfee0>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:48.009725 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fbba35dfee0>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:48.010077 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fbba35dfee0>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:48.010894 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=92583) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 28 14:12:48.011864 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading Plugin: flavors
May 28 14:12:48.016887 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=92583) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 28 14:12:48.017213 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading Plugin: revisions
May 28 14:12:48.021459 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=92583) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 28 14:12:48.021847 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_concurrency.lockutils [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.386s {{(pid=92583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:12:48.022628 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=92583) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
May 28 14:12:48.022968 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Initializing extension manager.
May 28 14:12:48.023448 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: __init__.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.023817 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: __pycache__ {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.024149 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.024475 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: address_group.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.025235 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.025796 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: address-group
May 28 14:12:48.026113 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: address_scope.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.026805 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.027304 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: address-scope
May 28 14:12:48.027640 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: admin_state_down_before_update.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.028594 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.029085 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: router-admin-state-down-before-update
May 28 14:12:48.029399 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: agent.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.030136 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.030614 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: agent
May 28 14:12:48.030927 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: agent_resources_synced.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.036679 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.037206 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: agent-resources-synced
May 28 14:12:48.037538 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: allowedaddresspairs.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.039336 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.039939 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: allowed-address-pairs
May 28 14:12:48.040269 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: auto_allocated_topology.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.041335 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.041850 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: auto-allocated-topology
May 28 14:12:48.042175 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: availability_zone.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.043409 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.043949 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: availability_zone
May 28 14:12:48.044279 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: availability_zone_filter.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.045180 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.045681 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: availability_zone_filter
May 28 14:12:48.046006 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: data_plane_status.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.046893 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.047395 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension data-plane-status not supported by any of loaded plugins
May 28 14:12:48.047744 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: default_subnetpools.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.048690 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.049193 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: default-subnetpools
May 28 14:12:48.049513 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: dhcpagentscheduler.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.050320 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.050823 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: dhcp_agent_scheduler
May 28 14:12:48.051144 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: dns.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.052074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.052574 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension dns-integration not supported by any of loaded plugins
May 28 14:12:48.052893 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: dns_domain_ports.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.053838 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.054334 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension dns-domain-ports not supported by any of loaded plugins
May 28 14:12:48.054652 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: dvr.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.055311 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.055843 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: dvr
May 28 14:12:48.056163 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: empty_string_filtering.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.057060 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.057564 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: empty-string-filtering
May 28 14:12:48.057883 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.059327 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.059927 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
May 28 14:12:48.060222 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.061119 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.061620 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
May 28 14:12:48.061939 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: external_net.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.062835 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.063339 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: external-net
May 28 14:12:48.063687 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: extra_dhcp_opt.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.064940 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.065446 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: extra_dhcp_opt
May 28 14:12:48.065764 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: extraroute.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.066659 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.067163 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: extraroute
May 28 14:12:48.067481 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: extraroute_atomic.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.068621 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.069109 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: extraroute-atomic
May 28 14:12:48.069428 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: filter_validation.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.076685 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.077183 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: filter-validation
May 28 14:12:48.077496 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: fip_pf_description.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.078583 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.079085 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
May 28 14:12:48.079406 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: fip_port_details.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.080361 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.080864 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: fip-port-details
May 28 14:12:48.081184 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: flavors.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.082438 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.082943 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: flavors
May 28 14:12:48.083275 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.084961 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.085475 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
May 28 14:12:48.085798 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: floatingip_pools.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.086491 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.086992 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: floatingip-pools
May 28 14:12:48.087311 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: ip_allocation.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.088247 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.088789 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension ip_allocation not supported by any of loaded plugins
May 28 14:12:48.089104 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.090591 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.091092 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: ip-substring-filtering
May 28 14:12:48.091410 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: l2_adjacency.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.092351 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.092847 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension l2_adjacency not supported by any of loaded plugins
May 28 14:12:48.093164 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: l3.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.094127 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.094637 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: router
May 28 14:12:48.094958 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: l3_conntrack_helper.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.097254 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.097775 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
May 28 14:12:48.098108 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.099031 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.099545 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: ext-gw-mode
May 28 14:12:48.099897 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.100799 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.101304 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: l3-ha
May 28 14:12:48.101627 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: l3_flavors.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.102593 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.103098 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: l3-flavors
May 28 14:12:48.103420 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.104360 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.104881 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: l3-port-ip-change-not-allowed
May 28 14:12:48.106090 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: l3agentscheduler.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.107126 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.107669 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: l3_agent_scheduler
May 28 14:12:48.107995 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: logging.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.109553 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.113856 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension logging not supported by any of loaded plugins
May 28 14:12:48.113856 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: metering.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.114408 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.114999 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: metering
May 28 14:12:48.115328 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.116596 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.117041 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: metering_source_and_destination_fields
May 28 14:12:48.117362 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: multiprovidernet.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.118401 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.118899 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: multi-provider
May 28 14:12:48.119215 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: netmtu.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.120130 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.120744 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: net-mtu
May 28 14:12:48.121558 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: netmtu_writable.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.122479 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.122976 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: net-mtu-writable
May 28 14:12:48.123291 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: network_availability_zone.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.123968 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.124465 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: network_availability_zone
May 28 14:12:48.124781 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: network_ip_availability.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.125842 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.126343 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: network-ip-availability
May 28 14:12:48.126657 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: network_segment_range.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.127406 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.127922 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension network-segment-range not supported by any of loaded plugins
May 28 14:12:48.128237 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: pagination.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.129191 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.129512 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: pagination
May 28 14:12:48.129822 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: port_device_profile.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.130698 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.131201 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: port-device-profile
May 28 14:12:48.131517 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.132464 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.132967 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: port-mac-address-regenerate
May 28 14:12:48.133279 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.134165 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.134664 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: port-numa-affinity-policy
May 28 14:12:48.134979 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: port_resource_request.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.135905 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.136917 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension port-resource-request not supported by any of loaded plugins
May 28 14:12:48.137232 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: portbindings.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.138133 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.138637 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: binding
May 28 14:12:48.138952 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: portbindings_extended.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.140298 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.140799 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: binding-extended
May 28 14:12:48.141118 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: portsecurity.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.142003 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.142500 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: port-security
May 28 14:12:48.142815 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: project_id.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.143789 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.148403 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: project-id
May 28 14:12:48.148403 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: providernet.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.148876 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.149380 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: provider
May 28 14:12:48.149691 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: qos.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.153797 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.154303 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension qos not supported by any of loaded plugins
May 28 14:12:48.154626 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.155871 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.156380 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
May 28 14:12:48.156704 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.157602 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.158111 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
May 28 14:12:48.158432 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: qos_default.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.159320 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.159858 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension qos-default not supported by any of loaded plugins
May 28 14:12:48.160178 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: qos_fip.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.160821 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.161336 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension qos-fip not supported by any of loaded plugins
May 28 14:12:48.161651 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: qos_gateway_ip.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.162547 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.163045 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension qos-gateway-ip not supported by any of loaded plugins
May 28 14:12:48.163360 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: qos_port_network_policy.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.164261 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.164883 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension qos-port-network-policy not supported by any of loaded plugins
May 28 14:12:48.165147 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: qos_rule_type_details.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.166029 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.166524 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension qos-rule-type-details not supported by any of loaded plugins
May 28 14:12:48.166834 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: qos_rules_alias.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.168380 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.168885 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension qos-rules-alias not supported by any of loaded plugins
May 28 14:12:48.171284 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: quotasv2.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.171284 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.171284 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: quotas
May 28 14:12:48.171284 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: quotasv2_detail.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.172651 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.172980 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: quota_details
May 28 14:12:48.173302 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: rbac.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.174341 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.174846 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: rbac-policies
May 28 14:12:48.175167 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: rbac_address_group.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.176090 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.176594 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: rbac-address-group
May 28 14:12:48.176913 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: rbac_address_scope.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.177811 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.178312 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: rbac-address-scope
May 28 14:12:48.178631 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: rbac_security_groups.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.179515 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.180031 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: rbac-security-groups
May 28 14:12:48.180346 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: rbac_subnetpool.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.181234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.181730 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: rbac-subnetpool
May 28 14:12:48.182143 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: revisionifmatch.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.183030 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.184090 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: revision-if-match
May 28 14:12:48.184405 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: revisions.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.185498 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.186001 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: standard-attr-revisions
May 28 14:12:48.186326 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: router_availability_zone.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.186977 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.187475 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: router_availability_zone
May 28 14:12:48.187821 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: routerservicetype.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.188712 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.189219 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension router-service-type not supported by any of loaded plugins
May 28 14:12:48.189547 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.190422 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.190930 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: security-groups-normalized-cidr
May 28 14:12:48.191248 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: security_groups_port_filtering.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.192168 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.192665 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: port-security-groups-filtering
May 28 14:12:48.192979 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.193863 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.194362 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: security-groups-remote-address-group
May 28 14:12:48.194676 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: securitygroup.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.204784 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.205329 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: security-group
May 28 14:12:48.205657 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: segment.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.206442 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.206941 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension segment not supported by any of loaded plugins
May 28 14:12:48.207262 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.208204 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.208704 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
May 28 14:12:48.209026 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: servicetype.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.217769 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.218288 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: service-type
May 28 14:12:48.218610 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: sorting.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.219588 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.219921 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: sorting
May 28 14:12:48.220239 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: standard_attr_segment.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.221122 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.221624 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension standard-attr-segment not supported by any of loaded plugins
May 28 14:12:48.221939 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: standardattrdescription.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.222570 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.223062 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: standard-attr-description
May 28 14:12:48.223381 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: stateful_security_group.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.224295 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.224794 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: stateful-security-group
May 28 14:12:48.225111 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: stdattrs_common.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.225668 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
May 28 14:12:48.225982 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.226964 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.227469 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
May 28 14:12:48.227805 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: subnet_onboard.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.228896 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.229400 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: subnet_onboard
May 28 14:12:48.229793 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.230983 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.231479 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
May 28 14:12:48.231817 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: subnet_service_types.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.232728 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.233259 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: subnet-service-types
May 28 14:12:48.233573 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: subnetallocation.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.234711 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.236708 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: subnet_allocation
May 28 14:12:48.237042 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.237728 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.238234 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: subnetpool-prefix-ops
May 28 14:12:48.238547 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.239447 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.239965 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
May 28 14:12:48.240280 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: tagging.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.241336 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.241852 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: standard-attr-tag
May 28 14:12:48.242171 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: timestamp.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.243339 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.243874 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loaded extension: standard-attr-timestamp
May 28 14:12:48.244197 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: trunk.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.245193 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.245720 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension trunk not supported by any of loaded plugins
May 28 14:12:48.246038 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: trunk_details.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.247004 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.247507 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension trunk-details not supported by any of loaded plugins
May 28 14:12:48.247847 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: uplink_status_propagation.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.248734 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.249233 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension uplink-status-propagation not supported by any of loaded plugins
May 28 14:12:48.249546 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Loading extension file: vlantransparent.py {{(pid=92583) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 28 14:12:48.250190 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=92583) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 28 14:12:48.250684 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extension vlan-transparent not supported by any of loaded plugins
May 28 14:12:48.253216 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:network
May 28 14:12:48.253952 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:subnet
May 28 14:12:48.255822 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:subnetpool
May 28 14:12:48.256436 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:port
May 28 14:12:48.257694 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.258127 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service FLAVORS assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.258743 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.259173 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.259497 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:router
May 28 14:12:48.260176 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:floatingip
May 28 14:12:48.260862 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service METERING assigned prefix: /metering {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.262873 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fbba34bf430>> rbac-policy before_create 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:48.263236 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fbba34bf430>> rbac-policy before_update 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:48.263603 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fbba34bf430>> rbac-policy before_delete 55550000 {{(pid=92583) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:12:48.264724 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of CountableResource for resource:rbac_policy
May 28 14:12:48.265181 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:security_group
May 28 14:12:48.265834 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:security_group_rule
May 28 14:12:48.266555 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service CORE assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.266878 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:subnetpool
May 28 14:12:48.267205 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] subnetpool is already registered
May 28 14:12:48.267831 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service CORE assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.268213 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:subnetpool
May 28 14:12:48.268472 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] subnetpool is already registered
May 28 14:12:48.271055 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.271479 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service FLAVORS assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.272093 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.272508 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.272833 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:router
May 28 14:12:48.273153 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] router is already registered
May 28 14:12:48.273815 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:floatingip
May 28 14:12:48.274138 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] floatingip is already registered
May 28 14:12:48.274759 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service METERING assigned prefix: /metering {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.275434 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of CountableResource for resource:rbac_policy
May 28 14:12:48.275782 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] rbac_policy is already registered
May 28 14:12:48.276319 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:security_group
May 28 14:12:48.276651 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] security_group is already registered
May 28 14:12:48.277874 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:security_group_rule
May 28 14:12:48.278210 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] security_group_rule is already registered
May 28 14:12:48.278878 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service CORE assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.279201 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:subnetpool
May 28 14:12:48.279524 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] subnetpool is already registered
May 28 14:12:48.280128 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.v2.resource_helper [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Service CORE assigned prefix:  {{(pid=92583) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 28 14:12:48.280446 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Creating instance of TrackedResource for resource:subnetpool
May 28 14:12:48.280761 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING neutron.quota.resource_registry [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] subnetpool is already registered
May 28 14:12:48.281385 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: extensions {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.282861 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: address-groups {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.284471 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: address-scopes {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.285673 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: agents {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.286816 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: auto-allocated-topology {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.288126 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: availability_zones {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.289421 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: dhcp-networks {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.290910 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: dhcp-agents {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.292329 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: routers {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.294128 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: flavors {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.295283 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: service_profiles {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.296517 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: next_providers {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.298013 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: service_profiles {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.299437 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: floatingip-pools {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.300651 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: routers {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.302434 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: floatingips {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.303636 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: l3-routers {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.304994 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: l3-agents {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.306393 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: metering-labels {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.307739 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: metering-label-rules {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.309029 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: network-ip-availabilities {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.310252 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: bindings {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.311918 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: quotas {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.313318 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: quotas {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.314705 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: rbac-policies {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.316005 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: security-groups {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.317199 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: security-group-rules {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.318419 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: service-providers {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.319648 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: subnetpools {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.322023 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: subnetpools {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.323458 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.325816 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.439654 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.441488 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.443236 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.445164 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.446820 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.448796 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.450628 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.452488 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron.api.extensions [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Extended resource: tags {{(pid=92583) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 28 14:12:48.458249 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING keystonemiddleware.auth_token [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
May 28 14:12:48.462972 dv-cinder-791281-3-iscsi neutron-server[92583]: WARNING keystonemiddleware.auth_token [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
May 28 14:12:48.471991 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_concurrency.lockutils [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Acquired lock "singleton_lock" {{(pid=92583) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 28 14:12:48.472464 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_concurrency.lockutils [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Releasing lock "singleton_lock" {{(pid=92583) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 28 14:12:48.473091 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO oslo_service.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Starting 2 workers
May 28 14:12:48.477714 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Started child 92694 {{(pid=92583) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 28 14:12:48.482971 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Started child 92695 {{(pid=92583) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 28 14:12:48.484124 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:12:48.484682 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO neutron.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Neutron service started, listening on 0.0.0.0:9696
May 28 14:12:48.485169 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Notify callbacks [] for process, before_spawn {{(pid=92583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:12:48.485631 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [-] (92694) wsgi starting up on http://0.0.0.0:9696
May 28 14:12:48.487526 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:12:48.487986 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO oslo_service.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Starting 1 workers
May 28 14:12:48.488961 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [-] (92695) wsgi starting up on http://0.0.0.0:9696
May 28 14:12:48.492675 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Started child 92696 {{(pid=92583) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 28 14:12:48.493179 dv-cinder-791281-3-iscsi neutron-server[92583]: INFO oslo_service.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Starting 1 workers
May 28 14:12:48.496166 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] calling RpcWorker wait() {{(pid=92696) _wait /opt/stack/neutron/neutron/service.py:128}}
May 28 14:12:48.496706 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] returning from RpcWorker wait() {{(pid=92696) _wait /opt/stack/neutron/neutron/service.py:135}}
May 28 14:12:48.497525 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Started child 92697 {{(pid=92583) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 28 14:12:48.497904 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:12:48.498290 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG neutron_lib.callbacks.manager [None req-e553eb74-547f-47a3-a1fe-e7eb1e9bb563 None None] Notify callbacks [] for process, after_spawn {{(pid=92583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:12:48.498403 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:12:48.500210 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92583) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 28 14:12:48.500415 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 28 14:12:48.500594 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 28 14:12:48.500802 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 28 14:12:48.501143 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 28 14:12:48.501300 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 28 14:12:48.501819 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.502478 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.502478 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.502723 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.503009 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.503297 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:12:48.503815 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.503815 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.504067 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.504339 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.504601 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.504771 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.504934 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.505206 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.505430 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.505780 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.506041 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.506257 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.506531 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.506732 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.506986 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.507341 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.507512 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.507779 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.507986 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.508408 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.508630 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.509127 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.509679 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.509679 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.509958 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.510108 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.510259 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.510396 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.510605 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.510870 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.511140 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.511420 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.511620 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.511872 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.512097 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.512554 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] host                           = dv-cinder-791281-3-iscsi {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.512781 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.512985 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.513238 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.513481 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.513807 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.513969 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.514167 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.514412 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.514661 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.514886 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.515130 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.515351 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.515590 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.515828 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.515973 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.516241 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.516472 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.516733 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.516924 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.517073 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.517251 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.517495 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.517647 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.517885 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.518118 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.518327 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.518536 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.518779 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.519004 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.519259 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.519484 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.519754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.519970 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.520211 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.520434 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.520671 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.520909 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.521140 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.521349 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.521589 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.521794 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.522038 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.522254 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.522463 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.522727 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.522935 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.523213 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.523448 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.523745 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.523992 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.524216 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.524375 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.524639 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.524865 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.525105 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.525345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.525554 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.525797 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.525994 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.526201 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.526441 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.526662 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.527428 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.527699 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.527914 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.528170 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.528381 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.528590 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.528817 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.529237 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.529575 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.529916 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.530122 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:12:48.530222 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.530386 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.530636 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.530864 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.531082 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.531330 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.531632 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.531921 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.532155 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.532446 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.532683 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.532943 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.533274 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.533533 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.533831 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.534048 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.534291 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.534544 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.534763 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.535101 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.535369 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.535639 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.59/identity {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.535900 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.536113 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.536350 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.536655 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.536789 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.537002 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.537212 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.537479 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.537712 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.537938 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.538153 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.538398 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.538641 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.538867 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.539104 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.539368 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.539635 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.539856 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.540085 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.540295 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.540524 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.540753 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.540979 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.541189 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.541426 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.541651 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.541933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.542088 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.543085 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.543240 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.543584 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.543817 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.544037 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.544256 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.544473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.544877 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.545012 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.545163 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.545380 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.545594 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.545815 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.546194 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.546290 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.546643 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.546737 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.546890 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.547101 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.547333 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.547543 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.547775 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.547985 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.548195 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.548405 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.548823 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.548953 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.549076 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.549261 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.549506 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.549737 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.550024 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.550324 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.550558 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.550809 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.551068 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.551319 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.551535 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.551802 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.552071 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.552274 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.552512 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.566099 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.566099 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.566099 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.566099 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.566099 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.566099 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.566099 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.566099 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.567157 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.567157 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.567157 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.567157 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.567157 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.567157 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.567157 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.567157 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.568089 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.568089 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.568089 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.568089 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.568089 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.568089 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.568089 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.568089 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.569751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.569751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.569751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.569751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.569751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.569751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.569751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.569751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.569751 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.571281 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.571281 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.571281 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.571281 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.571281 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.571281 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.571281 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.571281 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.572505 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.572505 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.572505 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.572505 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.572505 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.572505 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.572505 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.572505 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.59/identity {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.573470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.573470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.573470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.573470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.573470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.573470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.573470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.573470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.574074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.574074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.574074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.574074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.574074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.574074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.574074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.574074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575000 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575000 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575000 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575000 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575000 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575000 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575000 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575000 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.575766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.576473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.576473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.576473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.576473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.576473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.576473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.576473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.576473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577185 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577185 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577185 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577185 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577185 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577185 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577185 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577185 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.577933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.578667 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.578667 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.578667 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.578667 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.578667 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.578667 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.578667 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.579342 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.579342 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.579342 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.579675 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.579784 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.579992 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.580198 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.580429 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.580632 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.580874 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.581078 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.581300 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.581510 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.581711 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.582006 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.582231 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.582437 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.582647 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.582849 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.583086 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.583287 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.583490 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.583724 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.583927 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.584247 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.584495 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.584714 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.585006 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.585233 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.585475 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.585731 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.586062 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.586292 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.586528 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.586743 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.586957 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.587174 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.587423 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.587766 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.588057 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.588333 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.588592 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.588852 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.589129 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.589964 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.590175 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.590469 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.590798 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.591070 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.591328 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.591586 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.591866 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.592091 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.592327 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.592541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.592771 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.593027 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.593382 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.593650 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.593790 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.593989 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.594213 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.594446 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.594683 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.594921 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.595754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.595754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.595754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 28 14:12:48.604949 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92583) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 28 14:12:48.604949 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 28 14:12:48.604949 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 28 14:12:48.604949 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 28 14:12:48.604949 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 28 14:12:48.604949 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 28 14:12:48.604949 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.604949 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606277 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606277 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606277 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606277 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606277 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606277 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606277 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606277 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606787 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606787 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606787 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606787 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606787 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606787 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606787 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.606787 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607232 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607232 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607232 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607232 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607232 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607232 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607587 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607587 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607587 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607587 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607587 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607587 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607961 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607961 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607961 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607961 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607961 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607961 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607961 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.607961 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.608541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.608541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.608541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] host                           = dv-cinder-791281-3-iscsi {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.608541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.608541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.608541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.608541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.608541 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609094 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609094 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609094 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609094 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609094 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609094 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609094 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609094 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609094 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609686 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609686 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609686 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609686 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609686 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609686 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.609686 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610350 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610350 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610350 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610350 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610350 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610350 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610350 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610350 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610887 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610887 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610887 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610887 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610887 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610887 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610887 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.610887 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.611649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.611649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.611649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.611649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.611649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.611649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.611649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.611649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.611649 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612774 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612774 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612774 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612774 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612774 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612774 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612774 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.612774 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.613304 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.613304 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.613304 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.613304 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.613569 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.613569 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.613720 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 28 14:12:48.613931 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.614026 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.614158 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.614321 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.614502 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.614654 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.614802 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.614939 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.615101 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.615257 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.615425 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.615608 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.615772 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.615937 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.616084 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.616251 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.616372 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.616588 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.616682 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.616827 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.616983 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.617139 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.617310 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.617488 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.617628 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.59/identity {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.617786 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.617941 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.618093 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.618253 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.618413 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.618562 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.618718 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.618875 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.619032 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.619265 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.619427 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.619621 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.619786 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.619946 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.620253 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.620417 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.620601 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.620759 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.620919 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.621076 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.621234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.621391 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.621548 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.621705 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.621862 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.622043 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.622188 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.622345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.622500 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.622658 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.622814 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.622971 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.623127 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.623284 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.623441 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.623621 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.623796 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.623956 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.624112 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.624269 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.624426 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.624584 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.624740 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.624897 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.625056 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.625218 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.625368 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.625552 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.625664 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.625821 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.625978 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.626134 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.626291 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.626448 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.626605 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.626761 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.626918 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.627074 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.627229 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.627395 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.627587 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.627747 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.627905 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631098 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631098 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631098 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631098 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631098 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631098 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631098 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631098 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631652 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631652 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631652 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631652 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631652 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631652 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631652 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.631652 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.632352 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.632352 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.632352 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.632352 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.632352 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.632352 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.632352 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.632352 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.633788 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.633788 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.633788 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.633788 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.633788 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.633788 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.633788 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.633788 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.634345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.634345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.634345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.634345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.634345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.634345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.634345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.634345 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.635205 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.635205 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.635205 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.635205 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.635205 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.635205 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.635205 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.635205 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636166 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636166 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636166 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636166 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636166 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636166 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636166 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.59/identity {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.636754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.637051 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.637051 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.637196 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.637273 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.637393 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.637558 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.637710 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.637853 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.637994 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.638131 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.638286 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.638419 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.638575 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.638732 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.638909 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.639046 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.639202 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.639358 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.639515 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.639692 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.639854 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.640011 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.640169 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.640326 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.640484 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.640832 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.640832 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.641043 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.641126 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.641233 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.641390 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.641558 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.641694 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.641852 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.642008 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.642165 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.642323 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.642480 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.642638 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.642800 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.642971 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.643129 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.643285 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.643441 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.643619 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.643778 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.643933 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.644090 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.644247 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.644402 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.644558 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.644720 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.644872 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.645012 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.645169 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.645316 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.645458 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.645684 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.645839 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.646095 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.646095 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.646357 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.646357 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.646604 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.646735 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.646870 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.647005 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.647151 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.647294 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.647436 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.647620 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.647765 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.647897 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.648028 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.648162 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.648316 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.648455 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.648592 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.648723 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.648852 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.648981 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.649125 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.649283 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.649431 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.649596 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.649754 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.649916 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.650081 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.650234 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.650372 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.650508 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.650793 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.650925 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.651065 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.651202 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.651334 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.651473 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.651637 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.652302 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.652501 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.652706 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.652868 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.653017 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.653017 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.653334 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.653470 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.653606 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.653741 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.653885 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.654032 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.654181 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.654382 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.654517 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.654517 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.654822 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.654822 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.655188 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.655188 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.655501 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.655501 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.656172 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.656172 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.656172 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.656172 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.656172 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.656640 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.656640 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 28 14:12:48.656640 dv-cinder-791281-3-iscsi neutron-server[92583]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 28 14:12:48.684731 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:12:48.851341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 53844) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:12:48.860015 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [-] 10.222.0.59 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0065095
May 28 14:12:59.997005 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0152991-37c9-4484-9c53-474fc18fcbfd None None] get_active_networks_info from dv-cinder-791281-3-iscsi {{(pid=92696) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
May 28 14:13:00.074868 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0152991-37c9-4484-9c53-474fc18fcbfd None None] No non-hosted networks {{(pid=92696) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
May 28 14:13:00.081871 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.agentschedulers_db [None req-a0152991-37c9-4484-9c53-474fc18fcbfd None None] DHCP Agent not found on host dv-cinder-791281-3-iscsi {{(pid=92696) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
May 28 14:13:00.241841 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f0408255-75b2-49b7-b86a-7471f1c486ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798'] for agent, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:02.533932 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798'] for agent, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:02.538212 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.539594 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.543447 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.544179 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.547202 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.548318 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.549301 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.550389 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.552098 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.554913 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.556677 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.558100 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:02.559904 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fbba31c8df0>, 'Open vSwitch agent', 'dv-cinder-791281-3-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:02.572687 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fbba3168dc0>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-791281-3-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:02.579256 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1e2681c0-bd09-41d4-9803-b193d77a034c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798'] for agent, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:02.626174 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.db.api [None req-f9ee1595-d1e9-4e2a-9f94-bc269b5c425b None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agents.uniq_agents0agent_type0host'] with value(s) L3 agent-dv-cinder-791281-3-iscsi {{(pid=92696) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 28 14:13:02.626805 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_db.api [None req-f9ee1595-d1e9-4e2a-9f94-bc269b5c425b None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 28 14:13:03.223426 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f9ee1595-d1e9-4e2a-9f94-bc269b5c425b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:03.787044 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798'] for agent, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:05.246534 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798'] for agent, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:06.749133 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 53936) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:07.351978 dv-cinder-791281-3-iscsi neutron-server[92694]: WARNING oslo_policy.policy [None req-6b2d4f2b-4937-48a4-bd0e-9a52e71b6d0a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 28 14:13:07.352603 dv-cinder-791281-3-iscsi neutron-server[92694]: WARNING oslo_policy.policy [None req-6b2d4f2b-4937-48a4-bd0e-9a52e71b6d0a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 28 14:13:07.482593 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.db.l3_hamode_db [None req-90407af6-e030-485a-824e-cabb95bdd086 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
May 28 14:13:07.569502 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [None req-6b2d4f2b-4937-48a4-bd0e-9a52e71b6d0a admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92694) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:13:07.569728 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90407af6-e030-485a-824e-cabb95bdd086 None None] Routers set() bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:13:07.570086 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90407af6-e030-485a-824e-cabb95bdd086 None None] Router IDs set() for agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
May 28 14:13:07.570719 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6b2d4f2b-4937-48a4-bd0e-9a52e71b6d0a admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8193591
May 28 14:13:09.903018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 53950) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:10.477923 dv-cinder-791281-3-iscsi neutron-server[92695]: WARNING oslo_policy.policy [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 28 14:13:10.478504 dv-cinder-791281-3-iscsi neutron-server[92695]: WARNING oslo_policy.policy [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 28 14:13:10.694069 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] Request body: {'subnetpool': {'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'is_default': True, 'shared': True}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:13:10.797626 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.policy [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92695) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 28 14:13:10.842650 dv-cinder-791281-3-iscsi neutron-server[92695]: WARNING oslo_policy.policy [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 28 14:13:10.843023 dv-cinder-791281-3-iscsi neutron-server[92695]: WARNING oslo_policy.policy [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 28 14:13:10.851645 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.quota [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fbba2f91370>.
May 28 14:13:10.867524 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:13:10.999687 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8777745182204', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8777745182557', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8777745234224', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8777745231596', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8777745217383', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8777745911821', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-7931318', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-8280372', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-927026', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1000863'] for rbac-policy, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:11.249510 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:11.250799 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-42a37e51-a639-4185-b931-0ee1bf4298d0 admin admin] 10.222.0.59 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 1.3467398
May 28 14:13:13.889746 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 53968) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:14.253675 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Request body: {'network': {'admin_state_up': True, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'name': 'private', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:13:14.258610 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:13:14.263863 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Usage tracker for resource:network and tenant:9b2b06c2d4324e7c885f2ea84f6a3624 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:13:14.268582 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:13:14.275802 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:13:14.508948 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Made reservation on behalf of 9b2b06c2d4324e7c885f2ea84f6a3624 for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:13:14.512194 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:14.530579 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:14.544548 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:13:14.548902 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Usage tracker for resource:security_group_rule and tenant:9b2b06c2d4324e7c885f2ea84f6a3624 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:13:14.553901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:13:14.559640 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:13:14.656237 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:14.737794 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:14.742424 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:14.764283 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] vlan segment allocate from pool success with {'vlan_id': 896, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:13:14.789019 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8777742722789', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:14.789628 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fbba3ca6e50> segment precommit_create {{(pid=92695) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 28 14:13:14.790103 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Added segment 04ff5a2a-5d49-4361-851b-bdebe5b408b4 of type vlan for network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800
May 28 14:13:14.798385 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a031cf4f-ec2c-4b57-8145-8ee9ddfad548,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:14.854838 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.855252 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.855508 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.855848 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.856417 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.856738 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.857044 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.857374 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.858166 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.858467 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.858766 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.859060 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Tracked resource versions report:
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]: pushed versions:
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]: {   'AddressGroup': {'1.2'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'ConntrackHelper': {'1.0'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Log': {'1.0'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Network': {'1.1'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Port': {'1.7'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'PortForwarding': {'1.2'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'QosPolicy': {'1.8'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'SecurityGroup': {'1.4'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'SecurityGroupRule': {'1.2'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'SubPort': {'1.0'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Subnet': {'1.1'},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Trunk': {'1.1'}}
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]: consumer versions:
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]: {   DHCP agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     L3 agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     Metadata agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     Metering agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:     Open vSwitch agent@dv-cinder-791281-3-iscsi: {   'AddressGroup': '1.2',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'ConntrackHelper': '1.0',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Log': '1.0',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Network': '1.1',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Port': '1.7',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'PortForwarding': '1.2',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'QosPolicy': '1.8',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'SecurityGroup': '1.4',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'SecurityGroupRule': '1.2',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'SubPort': '1.0',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Subnet': '1.1',
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Trunk': '1.1'}}
May 28 14:13:14.860260 dv-cinder-791281-3-iscsi neutron-server[92695]:  {{(pid=92695) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 28 14:13:14.915620 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:14.920536 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:15.026621 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:15.028036 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:13:15.028682 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:15.033980 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:15.138636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Pushing event updated for resources: {'Network': ['ID=80ee4f6d-0818-4fa2-b445-f0cd3d16d800,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:15.142380 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:15.150004 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:13:15.235483 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 1.3446164
May 28 14:13:17.884794 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 53984) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:18.463914 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.policy [None req-a007482b-1796-467f-9168-51573268c719 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92694) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 28 14:13:18.509511 dv-cinder-791281-3-iscsi neutron-server[92694]: WARNING oslo_policy.policy [None req-a007482b-1796-467f-9168-51573268c719 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 28 14:13:18.509874 dv-cinder-791281-3-iscsi neutron-server[92694]: WARNING oslo_policy.policy [None req-a007482b-1796-467f-9168-51573268c719 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 28 14:13:18.518231 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a007482b-1796-467f-9168-51573268c719 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:13:18.519902 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-a007482b-1796-467f-9168-51573268c719 admin admin] 10.222.0.59 "GET /v2.0/networks/80ee4f6d-0818-4fa2-b445-f0cd3d16d800 HTTP/1.1" status: 200  len: 825 time: 0.6341901
May 28 14:13:18.553654 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-79a3cd9f-0fa3-4e44-b022-2cdee55284d7 admin admin] 10.222.0.59 "GET /v2.0/subnetpools/139cad3f-f12d-4742-a439-43629d83be0e HTTP/1.1" status: 200  len: 734 time: 0.0283699
May 28 14:13:18.563148 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'gateway_ip': '172.20.0.1', 'ip_version': 4, 'subnetpool_id': '139cad3f-f12d-4742-a439-43629d83be0e'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:13:18.564721 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.quota [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fbba328e640>.
May 28 14:13:18.570882 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:13:18.577049 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Usage tracker for resource:subnet and tenant:9b2b06c2d4324e7c885f2ea84f6a3624 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:13:18.580473 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:13:18.587456 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:13:18.662563 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Made reservation on behalf of 9b2b06c2d4324e7c885f2ea84f6a3624 for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:13:18.665665 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:19.232427 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:19.238410 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:19.315021 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Checking segment: {'id': '04ff5a2a-5d49-4361-851b-bdebe5b408b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:13:19.315386 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Network hostable DHCP agents. Network: 80ee4f6d-0818-4fa2-b445-f0cd3d16d800, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:13:19.335468 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=92b37249-6192-47f9-ac59-3e07c09a6d83,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:19.345826 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.346180 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.346501 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.346821 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.347237 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.347581 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.347886 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.348187 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.348566 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.348862 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.349161 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.349457 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Tracked resource versions report:
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]: pushed versions:
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]: {   'AddressGroup': {'1.2'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'ConntrackHelper': {'1.0'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Log': {'1.0'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Network': {'1.1'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Port': {'1.7'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'PortForwarding': {'1.2'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'QosPolicy': {'1.8'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'SecurityGroup': {'1.4'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'SecurityGroupRule': {'1.2'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'SubPort': {'1.0'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Subnet': {'1.1'},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Trunk': {'1.1'}}
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]: consumer versions:
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]: {   DHCP agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     L3 agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     Metadata agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     Metering agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:     Open vSwitch agent@dv-cinder-791281-3-iscsi: {   'AddressGroup': '1.2',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'ConntrackHelper': '1.0',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Log': '1.0',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Network': '1.1',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Port': '1.7',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'PortForwarding': '1.2',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'QosPolicy': '1.8',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'SecurityGroup': '1.4',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'SecurityGroupRule': '1.2',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'SubPort': '1.0',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Subnet': '1.1',
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Trunk': '1.1'}}
May 28 14:13:19.350538 dv-cinder-791281-3-iscsi neutron-server[92694]:  {{(pid=92694) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 28 14:13:19.380279 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:19.401344 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:13:19.560419 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 80ee4f6d-0818-4fa2-b445-f0cd3d16d800) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:13:19.565348 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:13:19.566005 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:19.570103 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-105db44e-e566-4c1f-9f50-e638f5ff9ffb None None] Network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:13:19.831594 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 1.2713847
May 28 14:13:19.878719 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-80ee4f6d-0818-4fa2-b445-f0cd3d16d800', 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'fixed_ips': [{'subnet_id': '92b37249-6192-47f9-ac59-3e07c09a6d83'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:13:19.879976 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:20.098995 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Allocated IP 172.20.0.2 (80ee4f6d-0818-4fa2-b445-f0cd3d16d800/92b37249-6192-47f9-ac59-3e07c09a6d83/98b0c650-52f0-4018-b3de-77a2f33b6926) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:13:20.351095 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:20.363950 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Transition to ACTIVE for port object 98b0c650-52f0-4018-b3de-77a2f33b6926 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:13:20.383907 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Transition to ACTIVE for port object 98b0c650-52f0-4018-b3de-77a2f33b6926 will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:13:20.486916 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:20.492154 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:20.555330 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:13:20.556512 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:13:20.562582 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:13:20.596632 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Pushing event updated for resources: {'Port': ['ID=98b0c650-52f0-4018-b3de-77a2f33b6926,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:20.617059 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.617310 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.617642 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.617967 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.618283 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.618712 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.619164 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.619532 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.620015 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.620869 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Tracked resource versions report:
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]: pushed versions:
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]: {   'AddressGroup': {'1.2'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'ConntrackHelper': {'1.0'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Log': {'1.0'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Network': {'1.1'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Port': {'1.7'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'PortForwarding': {'1.2'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'QosPolicy': {'1.8'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'SecurityGroup': {'1.4'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'SecurityGroupRule': {'1.2'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'SubPort': {'1.0'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Subnet': {'1.1'},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Trunk': {'1.1'}}
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]: consumer versions:
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]: {   DHCP agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     L3 agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     Metadata agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     Metering agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:     Open vSwitch agent@dv-cinder-791281-3-iscsi: {   'AddressGroup': '1.2',
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'ConntrackHelper': '1.0',
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Log': '1.0',
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Network': '1.1',
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Port': '1.7',
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'PortForwarding': '1.2',
May 28 14:13:20.626865 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'QosPolicy': '1.8',
May 28 14:13:20.628533 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'SecurityGroup': '1.4',
May 28 14:13:20.628533 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'SecurityGroupRule': '1.2',
May 28 14:13:20.628533 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'SubPort': '1.0',
May 28 14:13:20.628533 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Subnet': '1.1',
May 28 14:13:20.628533 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Trunk': '1.1'}}
May 28 14:13:20.628533 dv-cinder-791281-3-iscsi neutron-server[92696]:  {{(pid=92696) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 28 14:13:20.654273 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:20.674318 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Attempting to bind port 98b0c650-52f0-4018-b3de-77a2f33b6926 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:13:20.674714 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Attempting to bind port 98b0c650-52f0-4018-b3de-77a2f33b6926 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '04ff5a2a-5d49-4361-851b-bdebe5b408b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:13:20.675246 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Attempting to bind port 98b0c650-52f0-4018-b3de-77a2f33b6926 on network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:13:20.681564 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 13, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:13:20.682092 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Checking segment: {'id': '04ff5a2a-5d49-4361-851b-bdebe5b408b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:13:20.682733 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:20.683197 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Bound using segment: {'id': '04ff5a2a-5d49-4361-851b-bdebe5b408b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:13:20.683969 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Bound port: 98b0c650-52f0-4018-b3de-77a2f33b6926, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '04ff5a2a-5d49-4361-851b-bdebe5b408b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:13:20.684419 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:20.784396 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] For port 98b0c650-52f0-4018-b3de-77a2f33b6926, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:13:20.789137 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] For port 98b0c650-52f0-4018-b3de-77a2f33b6926, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=98b0c650-52f0-4018-b3de-77a2f33b6926,segment=NetworkSegment(04ff5a2a-5d49-4361-851b-bdebe5b408b4),segment_id=04ff5a2a-5d49-4361-851b-bdebe5b408b4)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:13:20.852365 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:20.856808 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:20.943034 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Pushing event updated for resources: {'Port': ['ID=98b0c650-52f0-4018-b3de-77a2f33b6926,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:20.946098 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:22.255315 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54000) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:22.637017 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [None req-44560723-bbeb-458a-aafd-33d11e7c17e5 admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92695) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:13:22.652043 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-44560723-bbeb-458a-aafd-33d11e7c17e5 admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3817132
May 28 14:13:25.040030 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54010) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:25.474294 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [None req-4b127044-a280-4069-80cd-51c946b2d96f admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92695) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:13:25.475278 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-4b127044-a280-4069-80cd-51c946b2d96f admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.4344115
May 28 14:13:26.372598 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 98b0c650-52f0-4018-b3de-77a2f33b6926 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:13:26.506522 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 98b0c650-52f0-4018-b3de-77a2f33b6926 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:13:26.579436 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6054fbe8-1e7c-4e56-915c-25b8deadaaa2 None None] Network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:13:26.773037 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a7292d71-65f1-402a-b0d9-d89beb6c65cd None None] Provisioning for port 98b0c650-52f0-4018-b3de-77a2f33b6926 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:13:26.782828 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a7292d71-65f1-402a-b0d9-d89beb6c65cd None None] Provisioning complete for port 98b0c650-52f0-4018-b3de-77a2f33b6926 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:13:26.783220 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a7292d71-65f1-402a-b0d9-d89beb6c65cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:26.978918 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a7292d71-65f1-402a-b0d9-d89beb6c65cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:27.019689 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-a7292d71-65f1-402a-b0d9-d89beb6c65cd None None] For port 98b0c650-52f0-4018-b3de-77a2f33b6926, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=98b0c650-52f0-4018-b3de-77a2f33b6926,segment=NetworkSegment(04ff5a2a-5d49-4361-851b-bdebe5b408b4),segment_id=04ff5a2a-5d49-4361-851b-bdebe5b408b4)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:13:27.129380 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a7292d71-65f1-402a-b0d9-d89beb6c65cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:27.131594 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:27.199196 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7292d71-65f1-402a-b0d9-d89beb6c65cd None None] Pushing event updated for resources: {'Port': ['ID=98b0c650-52f0-4018-b3de-77a2f33b6926,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:27.202763 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-a7292d71-65f1-402a-b0d9-d89beb6c65cd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:27.257916 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-6a0c073f-844a-4721-bb19-7ba97847e8b4 None None] Provisioning complete for port 98b0c650-52f0-4018-b3de-77a2f33b6926 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:13:27.258219 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6a0c073f-844a-4721-bb19-7ba97847e8b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:28.136556 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54026) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:28.333585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 98b0c650-52f0-4018-b3de-77a2f33b6926 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:13:28.401117 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 98b0c650-52f0-4018-b3de-77a2f33b6926 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:13:28.401505 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:28.505563 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:13:28.510371 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:13:28.514112 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Usage tracker for resource:router and tenant:9b2b06c2d4324e7c885f2ea84f6a3624 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:13:28.517466 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:13:28.524885 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:13:28.649767 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:28.651437 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:28.674254 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:28.838654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:28.952231 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:28.953414 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-ee10fc34-b763-4389-ad9b-e0e3b33d4f79 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.8158576
May 28 14:13:29.966081 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f147c3a6-8301-499f-831a-8227e4adda64 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:31.364097 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 54036) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:31.742437 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [None req-6ecfafbb-0c42-4c32-a1af-4ebe8abe4bf8 admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92694) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:13:31.743422 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6ecfafbb-0c42-4c32-a1af-4ebe8abe4bf8 admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3784041
May 28 14:13:32.483476 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:32.537236 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6cb8d80f-d02d-40f5-8a92-93a05821ef73 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:33.634451 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:34.170504 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54056) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:34.326798 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Request body: {'network': {'admin_state_up': True, 'provider:network_type': 'flat', 'name': 'public', 'is_default': True, 'provider:physical_network': 'physnet1', 'router:external': True}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:13:34.331794 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:13:34.335610 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Usage tracker for resource:network and tenant:96a8567604aa4b5d8645ca18159c6f3d is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:13:34.338624 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:13:34.344277 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:13:34.420960 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Made reservation on behalf of 96a8567604aa4b5d8645ca18159c6f3d for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:13:34.423257 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:34.435930 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:34.451434 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:13:34.455576 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Usage tracker for resource:security_group_rule and tenant:96a8567604aa4b5d8645ca18159c6f3d is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:13:34.458489 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:13:34.464894 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:13:34.552380 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:34.622904 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:34.626071 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:34.641690 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Reserving flat network on physical network physnet1 {{(pid=92695) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
May 28 14:13:34.661973 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdd4f0f2-8165-4e18-b6b0-01997fcc071e,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:34.665800 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:34.666709 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:34.667689 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Added segment 05effb8c-4f51-4169-bfda-7593cb4b5695 of type flat for network f203e1e9-7403-4723-8925-7d733bca2c40
May 28 14:13:34.699536 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:34.805691 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:34.807015 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:13:34.808193 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:34.811568 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:34.924485 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Pushing event updated for resources: {'Network': ['ID=f203e1e9-7403-4723-8925-7d733bca2c40,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:34.926975 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:34.934817 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network f203e1e9-7403-4723-8925-7d733bca2c40 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:13:35.004372 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.8328578
May 28 14:13:35.194233 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:37.169391 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54076) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:37.281029 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-524edb22-ac54-469e-983b-5f15ffa7049f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:13:37.282387 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-524edb22-ac54-469e-983b-5f15ffa7049f admin admin] 10.222.0.59 "GET /v2.0/subnets/92b37249-6192-47f9-ac59-3e07c09a6d83 HTTP/1.1" status: 200  len: 849 time: 0.1120689
May 28 14:13:37.428171 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-2e207553-7972-4cec-a0e9-2ddb7424e465 admin admin] 10.222.0.59 "GET /v2.0/routers/b3f81ad8-4795-47f6-9ed7-88325b31b95e HTTP/1.1" status: 200  len: 704 time: 0.1404650
May 28 14:13:37.889381 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:38.121616 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Allocated IP 172.20.0.1 (80ee4f6d-0818-4fa2-b445-f0cd3d16d800/92b37249-6192-47f9-ac59-3e07c09a6d83/57d53642-52ec-46bc-bc74-e6458168444c) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:13:38.277889 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:38.295370 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Transition to ACTIVE for port object 57d53642-52ec-46bc-bc74-e6458168444c will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:13:38.406419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:38.410503 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:38.476403 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:13:38.479379 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:13:38.484043 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:13:38.484616 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:38.666846 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Pushing event updated for resources: {'Port': ['ID=57d53642-52ec-46bc-bc74-e6458168444c,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:38.678208 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:38.766037 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-ec6f732f-3077-46a2-b54f-9e6184d2abcf None None] Provisioning for port 57d53642-52ec-46bc-bc74-e6458168444c completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:13:38.771442 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-ec6f732f-3077-46a2-b54f-9e6184d2abcf None None] Provisioning complete for port 57d53642-52ec-46bc-bc74-e6458168444c triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:13:38.771945 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-ec6f732f-3077-46a2-b54f-9e6184d2abcf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:38.825545 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-ec6f732f-3077-46a2-b54f-9e6184d2abcf None None] Port 57d53642-52ec-46bc-bc74-e6458168444c cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:13:38.923899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:39.152705 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:39.222598 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:39.223737 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:39.227170 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:39.359132 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Pushing event updated for resources: {'Port': ['ID=57d53642-52ec-46bc-bc74-e6458168444c,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:39.363311 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:39.420383 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:13:39.421503 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:13:39.649896 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-23589ce0-9039-4664-a1b3-60a6e5ec607e None None] Provisioning complete for port 57d53642-52ec-46bc-bc74-e6458168444c triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:13:39.650256 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-23589ce0-9039-4664-a1b3-60a6e5ec607e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:39.685814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Router b3f81ad8-4795-47f6-9ed7-88325b31b95e is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92695) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:13:39.709281 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-23589ce0-9039-4664-a1b3-60a6e5ec607e None None] Port 57d53642-52ec-46bc-bc74-e6458168444c cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:13:39.841808 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:13:39.851168 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Sync routers for ids ['b3f81ad8-4795-47f6-9ed7-88325b31b95e'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:13:39.851677 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] 10.222.0.59 "PUT /v2.0/routers/b3f81ad8-4795-47f6-9ed7-88325b31b95e/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.4182079
May 28 14:13:39.861922 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Routers {'b3f81ad8-4795-47f6-9ed7-88325b31b95e'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:13:39.862892 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba311a670>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:13:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['b3f81ad8-4795-47f6-9ed7-88325b31b95e'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:40.040851 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Set router b3f81ad8-4795-47f6-9ed7-88325b31b95e gateway port host: None {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:13:40.420156 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba311a670>, [{'id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'name': 'router1', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:13:28Z', 'updated_at': '2021-05-28T14:13:38Z', 'revision_number': 2, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'gw_port_host': None, '_interfaces': [{'id': '57d53642-52ec-46bc-bc74-e6458168444c', 'name': '', 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'mac_address': 'fa:16:3e:30:2c:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:13:37Z', 'updated_at': '2021-05-28T14:13:38Z', 'revision_number': 2, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'subnets': [{'id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '139cad3f-f12d-4742-a439-43629d83be0e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:40.425139 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Checking router: b3f81ad8-4795-47f6-9ed7-88325b31b95e for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:13:40.425506 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Updating router b3f81ad8-4795-47f6-9ed7-88325b31b95e port 57d53642-52ec-46bc-bc74-e6458168444c binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:13:40.478931 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:40.872349 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:40.888520 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Transition to ACTIVE for port object 57d53642-52ec-46bc-bc74-e6458168444c will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:13:40.941082 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:40.948529 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:41.154773 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Pushing event updated for resources: {'Port': ['ID=57d53642-52ec-46bc-bc74-e6458168444c,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:41.172402 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.172740 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.173073 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.173397 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.173718 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.174040 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.174356 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.174670 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.174989 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.175299 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.175629 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.175942 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Tracked resource versions report:
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]: pushed versions:
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]: {   'AddressGroup': {'1.2'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'ConntrackHelper': {'1.0'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Log': {'1.0'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Network': {'1.1'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Port': {'1.7'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'PortForwarding': {'1.2'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'QosPolicy': {'1.8'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'SecurityGroup': {'1.4'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'SecurityGroupRule': {'1.2'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'SubPort': {'1.0'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Subnet': {'1.1'},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Trunk': {'1.1'}}
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]: consumer versions:
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]: {   DHCP agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     L3 agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     Metadata agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     Metering agent@dv-cinder-791281-3-iscsi: {},
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:     Open vSwitch agent@dv-cinder-791281-3-iscsi: {   'AddressGroup': '1.2',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'ConntrackHelper': '1.0',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Log': '1.0',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Network': '1.1',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Port': '1.7',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'PortForwarding': '1.2',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'QosPolicy': '1.8',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'SecurityGroup': '1.4',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'SecurityGroupRule': '1.2',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'SubPort': '1.0',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Subnet': '1.1',
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Trunk': '1.1'}}
May 28 14:13:41.176999 dv-cinder-791281-3-iscsi neutron-server[92697]:  {{(pid=92697) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 28 14:13:41.188112 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:41.196531 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Attempting to bind port 57d53642-52ec-46bc-bc74-e6458168444c on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:13:41.197053 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Attempting to bind port 57d53642-52ec-46bc-bc74-e6458168444c by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '04ff5a2a-5d49-4361-851b-bdebe5b408b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:13:41.197498 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Attempting to bind port 57d53642-52ec-46bc-bc74-e6458168444c on network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:13:41.205517 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 13, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:13:41.206025 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Checking segment: {'id': '04ff5a2a-5d49-4361-851b-bdebe5b408b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:13:41.206608 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:41.207110 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Bound using segment: {'id': '04ff5a2a-5d49-4361-851b-bdebe5b408b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:13:41.207967 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Bound port: 57d53642-52ec-46bc-bc74-e6458168444c, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '04ff5a2a-5d49-4361-851b-bdebe5b408b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:13:41.208456 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:41.310661 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] For port 57d53642-52ec-46bc-bc74-e6458168444c, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:13:41.314841 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] For port 57d53642-52ec-46bc-bc74-e6458168444c, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=57d53642-52ec-46bc-bc74-e6458168444c,segment=NetworkSegment(04ff5a2a-5d49-4361-851b-bdebe5b408b4),segment_id=04ff5a2a-5d49-4361-851b-bdebe5b408b4)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:13:41.395033 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:41.399054 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:41.492140 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Routers {'b3f81ad8-4795-47f6-9ed7-88325b31b95e'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:13:41.492790 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba311a670>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:13:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['b3f81ad8-4795-47f6-9ed7-88325b31b95e'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:41.549655 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Pushing event updated for resources: {'Port': ['ID=57d53642-52ec-46bc-bc74-e6458168444c,revision_number=4']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:41.562684 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:41.656817 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] Set router b3f81ad8-4795-47f6-9ed7-88325b31b95e gateway port host: None {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:13:42.010797 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba311a670>, [{'id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'name': 'router1', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:13:28Z', 'updated_at': '2021-05-28T14:13:38Z', 'revision_number': 2, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'gw_port_host': None, '_interfaces': [{'id': '57d53642-52ec-46bc-bc74-e6458168444c', 'name': '', 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'mac_address': 'fa:16:3e:30:2c:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:13:37Z', 'updated_at': '2021-05-28T14:13:41Z', 'revision_number': 4, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'subnets': [{'id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '139cad3f-f12d-4742-a439-43629d83be0e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:42.011527 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 54088) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:42.015076 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2762c266-392d-4721-a5ca-366e482f0eae None None] The sync data for ids ['b3f81ad8-4795-47f6-9ed7-88325b31b95e'] in dv-cinder-791281-3-iscsi is: [{'id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'name': 'router1', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:13:28Z', 'updated_at': '2021-05-28T14:13:38Z', 'revision_number': 2, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'gw_port_host': None, '_interfaces': [{'id': '57d53642-52ec-46bc-bc74-e6458168444c', 'name': '', 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'mac_address': 'fa:16:3e:30:2c:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:13:37Z', 'updated_at': '2021-05-28T14:13:41Z', 'revision_number': 4, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'subnets': [{'id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '139cad3f-f12d-4742-a439-43629d83be0e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:13:42.184801 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8190e41-70be-462a-afff-e7c407cb2321 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:13:42.186187 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-f8190e41-70be-462a-afff-e7c407cb2321 admin admin] 10.222.0.59 "GET /v2.0/networks/f203e1e9-7403-4723-8925-7d733bca2c40 HTTP/1.1" status: 200  len: 842 time: 0.1736195
May 28 14:13:42.195317 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Request body: {'subnet': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'cidr': '172.27.3.0/24', 'ip_version': 4, 'name': 'public-subnet', 'gateway_ip': '172.27.3.1', 'enable_dhcp': False}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:13:42.200414 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:13:42.204123 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Usage tracker for resource:subnet and tenant:96a8567604aa4b5d8645ca18159c6f3d is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:13:42.206870 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:13:42.212973 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:13:42.296933 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Made reservation on behalf of 96a8567604aa4b5d8645ca18159c6f3d for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:13:42.299242 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:42.819829 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.objects.ports [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=92694) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
May 28 14:13:42.820293 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:42.825078 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-70a15eeb-91e3-498d-a14d-44a082b2c1b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:42.905056 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f0cd2108-42a0-4380-970f-9928591eb252,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:42.911121 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:42.913615 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:13:42.913962 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Network hostable DHCP agents. Network: f203e1e9-7403-4723-8925-7d733bca2c40, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:13:43.028437 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:13:43.095136 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, f203e1e9-7403-4723-8925-7d733bca2c40) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:13:43.099095 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:13:43.099712 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:43.106937 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b7d868a-6143-48f4-9ef6-254c6bbfb04a None None] Network f203e1e9-7403-4723-8925-7d733bca2c40 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:13:43.176789 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.9845295
May 28 14:13:43.330705 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94ee2df5-fd94-4868-b03d-56b834effca0 None None] Network f203e1e9-7403-4723-8925-7d733bca2c40 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:13:45.557883 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 54102) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:45.791041 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-9ab00dc0-f880-4fba-ba8c-99f06e1b07ed admin admin] 10.222.0.59 "GET /v2.0/routers/b3f81ad8-4795-47f6-9ed7-88325b31b95e HTTP/1.1" status: 200  len: 710 time: 0.2320409
May 28 14:13:45.925262 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-750e8bd1-3049-41c2-bc77-71553f8cfdca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:13:45.926931 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-750e8bd1-3049-41c2-bc77-71553f8cfdca admin admin] 10.222.0.59 "GET /v2.0/networks/f203e1e9-7403-4723-8925-7d733bca2c40 HTTP/1.1" status: 200  len: 886 time: 0.1307652
May 28 14:13:45.936492 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:13:46.355662 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 57d53642-52ec-46bc-bc74-e6458168444c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:13:46.440972 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:46.500701 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 57d53642-52ec-46bc-bc74-e6458168444c completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:13:46.505795 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 57d53642-52ec-46bc-bc74-e6458168444c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:13:46.506220 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:46.633068 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:46.664910 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 57d53642-52ec-46bc-bc74-e6458168444c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=57d53642-52ec-46bc-bc74-e6458168444c,segment=NetworkSegment(04ff5a2a-5d49-4361-851b-bdebe5b408b4),segment_id=04ff5a2a-5d49-4361-851b-bdebe5b408b4)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:13:46.748660 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:46.750740 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:46.824928 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=57d53642-52ec-46bc-bc74-e6458168444c,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:46.827723 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:46.859406 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:46.920120 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:47.062775 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Allocated IP 172.27.3.57 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/58cc7f0d-a0f9-401b-94df-d192ee3b4a86) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:13:47.222320 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:47.373517 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:47.377555 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:47.440000 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:13:47.442752 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:13:47.447211 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:13:47.506118 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Pushing event updated for resources: {'Port': ['ID=58cc7f0d-a0f9-401b-94df-d192ee3b4a86,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:47.565594 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:47.957456 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:48.342312 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 57d53642-52ec-46bc-bc74-e6458168444c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:13:48.344745 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:48.348052 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-682030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-682095', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-685819'] for router, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:48.413755 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 57d53642-52ec-46bc-bc74-e6458168444c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:13:48.414115 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:48.546129 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Router b3f81ad8-4795-47f6-9ed7-88325b31b95e has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:13:48.734602 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:13:48.746301 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Sync routers for ids ['b3f81ad8-4795-47f6-9ed7-88325b31b95e'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:13:48.746645 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Notify callbacks [] for router, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:48.748252 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] 10.222.0.59 "PUT /v2.0/routers/b3f81ad8-4795-47f6-9ed7-88325b31b95e HTTP/1.1" status: 200  len: 889 time: 2.8151639
May 28 14:13:48.757927 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Routers {'b3f81ad8-4795-47f6-9ed7-88325b31b95e'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:13:48.758619 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27984f0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:13:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['b3f81ad8-4795-47f6-9ed7-88325b31b95e'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:48.973266 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Set router b3f81ad8-4795-47f6-9ed7-88325b31b95e gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:13:49.351111 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27984f0>, [{'id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'name': 'router1', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.57'}], 'enable_snat': True}, 'gw_port_id': '58cc7f0d-a0f9-401b-94df-d192ee3b4a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:13:28Z', 'updated_at': '2021-05-28T14:13:47Z', 'revision_number': 4, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'gw_port': {'id': '58cc7f0d-a0f9-401b-94df-d192ee3b4a86', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:d7:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:13:46Z', 'updated_at': '2021-05-28T14:13:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '57d53642-52ec-46bc-bc74-e6458168444c', 'name': '', 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'mac_address': 'fa:16:3e:30:2c:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:13:37Z', 'updated_at': '2021-05-28T14:13:46Z', 'revision_number': 5, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'subnets': [{'id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '139cad3f-f12d-4742-a439-43629d83be0e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:49.356135 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Checking router: b3f81ad8-4795-47f6-9ed7-88325b31b95e for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:13:49.356755 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Updating router b3f81ad8-4795-47f6-9ed7-88325b31b95e port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:13:49.415299 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:49.752924 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:49.763873 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Transition to ACTIVE for port object 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:13:49.826824 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:49.831803 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:49.912156 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Attempting to bind port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:13:49.912953 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Attempting to bind port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:13:49.913163 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Attempting to bind port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:13:49.914985 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7664b5-6164-4593-8e00-082bbe46eb86 None None] Pushing event updated for resources: {'Port': ['ID=58cc7f0d-a0f9-401b-94df-d192ee3b4a86,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:49.918790 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-1b7664b5-6164-4593-8e00-082bbe46eb86 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:49.921770 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 13, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:13:49.922161 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:13:49.922577 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:49.922903 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:13:49.923368 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Bound port: 58cc7f0d-a0f9-401b-94df-d192ee3b4a86, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:13:49.923769 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:50.003397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] For port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:13:50.006545 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] For port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=58cc7f0d-a0f9-401b-94df-d192ee3b4a86,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:13:50.109664 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:50.114152 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-a7292d71-65f1-402a-b0d9-d89beb6c65cd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:50.197248 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Routers {'b3f81ad8-4795-47f6-9ed7-88325b31b95e'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:13:50.197892 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27984f0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:13:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['b3f81ad8-4795-47f6-9ed7-88325b31b95e'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:50.245501 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7664b5-6164-4593-8e00-082bbe46eb86 None None] Pushing event updated for resources: {'Port': ['ID=58cc7f0d-a0f9-401b-94df-d192ee3b4a86,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:50.253653 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-1b7664b5-6164-4593-8e00-082bbe46eb86 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:50.382641 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] Set router b3f81ad8-4795-47f6-9ed7-88325b31b95e gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:13:50.741186 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27984f0>, [{'id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'name': 'router1', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.57'}], 'enable_snat': True}, 'gw_port_id': '58cc7f0d-a0f9-401b-94df-d192ee3b4a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:13:28Z', 'updated_at': '2021-05-28T14:13:47Z', 'revision_number': 4, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'gw_port': {'id': '58cc7f0d-a0f9-401b-94df-d192ee3b4a86', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:d7:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:13:46Z', 'updated_at': '2021-05-28T14:13:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '57d53642-52ec-46bc-bc74-e6458168444c', 'name': '', 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'mac_address': 'fa:16:3e:30:2c:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:13:37Z', 'updated_at': '2021-05-28T14:13:46Z', 'revision_number': 5, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'subnets': [{'id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '139cad3f-f12d-4742-a439-43629d83be0e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:13:50.745245 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a62444a-00f1-4c51-8ecc-404d6d127787 None None] The sync data for ids ['b3f81ad8-4795-47f6-9ed7-88325b31b95e'] in dv-cinder-791281-3-iscsi is: [{'id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'name': 'router1', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.57'}], 'enable_snat': True}, 'gw_port_id': '58cc7f0d-a0f9-401b-94df-d192ee3b4a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:13:28Z', 'updated_at': '2021-05-28T14:13:47Z', 'revision_number': 4, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'gw_port': {'id': '58cc7f0d-a0f9-401b-94df-d192ee3b4a86', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:d7:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:13:46Z', 'updated_at': '2021-05-28T14:13:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '57d53642-52ec-46bc-bc74-e6458168444c', 'name': '', 'network_id': '80ee4f6d-0818-4fa2-b445-f0cd3d16d800', 'tenant_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'mac_address': 'fa:16:3e:30:2c:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f81ad8-4795-47f6-9ed7-88325b31b95e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:13:37Z', 'updated_at': '2021-05-28T14:13:46Z', 'revision_number': 5, 'project_id': '9b2b06c2d4324e7c885f2ea84f6a3624', 'subnets': [{'id': '92b37249-6192-47f9-ac59-3e07c09a6d83', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '139cad3f-f12d-4742-a439-43629d83be0e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:13:51.146271 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 54112) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:13:51.272866 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-4038e754-20d5-4e94-b1d2-bb5af342204f admin admin] 10.222.0.59 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 410 time: 0.1254783
May 28 14:13:52.371918 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:13:52.501003 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:13:52.506152 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:13:52.506526 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:52.630874 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:52.647228 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=58cc7f0d-a0f9-401b-94df-d192ee3b4a86,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:13:52.731076 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:52.733526 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:13:52.798749 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=58cc7f0d-a0f9-401b-94df-d192ee3b4a86,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:13:52.801808 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:13:54.352732 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:13:54.423174 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 58cc7f0d-a0f9-401b-94df-d192ee3b4a86 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:13:54.423565 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:13:56.552437 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 5 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:14:00.040511 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-01a5f61b-5358-443b-bee2-8770022f56b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:02.495796 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:02.529057 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-9c50f05d-d545-46b1-819e-f0c802f0c6be None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:03.614816 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:05.222325 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:30.033570 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d15770ff-29fd-4e1d-b842-a1c0d29c9d12 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:32.473527 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:32.505831 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-52680f14-4200-497f-b5c2-9c7ec2bc9474 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:33.552257 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 5 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:14:33.627383 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:36.102215 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:14:59.993764 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-9a802206-491a-440b-ac13-d3bbb03085b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:02.494433 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:02.540336 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-9a4b6d26-adda-4102-871b-a947bd5ca757 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:03.604403 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:05.242815 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:10.552030 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 5 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:15:29.749967 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 54682) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:29.816259 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.pecan_wsgi.hooks.translation [None req-e7900030-b6e8-4c2f-b651-749fd5a6bd08 admin admin] GET failed (client error): The resource could not be found.
May 28 14:15:29.817547 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e7900030-b6e8-4c2f-b651-749fd5a6bd08 admin admin] 10.222.0.59 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0666516
May 28 14:15:29.948679 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a10423c7-3c66-4386-ac49-881463a7c958 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:29.950074 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-a10423c7-3c66-4386-ac49-881463a7c958 admin admin] 10.222.0.59 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1282661
May 28 14:15:29.975889 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6f13e324-0cfe-441b-bbd5-365a3d29d6e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:32.081430 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54692) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:32.198280 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-898bd219-480e-47ab-84c2-213ed038a59c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:32.199670 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-898bd219-480e-47ab-84c2-213ed038a59c admin admin] 10.222.0.59 "GET /v2.0/subnets/92b37249-6192-47f9-ac59-3e07c09a6d83 HTTP/1.1" status: 200  len: 849 time: 0.1173103
May 28 14:15:32.209071 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:15:32.323017 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Notify callbacks [] for subnet, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:32.535375 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:32.579922 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7fa238b4-0a43-47a4-af11-d5601aaccfe0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:32.644403 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8777742695581'] for subnet, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:32.648801 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:15:32.732033 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:32.733408 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:32.734106 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] 10.222.0.59 "PUT /v2.0/subnets/92b37249-6192-47f9-ac59-3e07c09a6d83 HTTP/1.1" status: 200  len: 868 time: 0.5289216
May 28 14:15:32.759192 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=92b37249-6192-47f9-ac59-3e07c09a6d83,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:15:32.759459 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f8f6827-6c8c-42ec-a6bf-b640a196e3c7 None None] Network 80ee4f6d-0818-4fa2-b445-f0cd3d16d800 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:15:32.767040 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.767600 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.767938 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.768265 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.768590 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.768934 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.769254 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.769569 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.769884 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.770276 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.770590 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.770898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:15:32.774935 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:15:33.222600 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7834d3a8-a113-4673-9898-8970a78a1119 None None] Provisioning complete for port 57d53642-52ec-46bc-bc74-e6458168444c triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:15:33.222968 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7834d3a8-a113-4673-9898-8970a78a1119 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:33.359115 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7834d3a8-a113-4673-9898-8970a78a1119 None None] Provisioning complete for port 98b0c650-52f0-4018-b3de-77a2f33b6926 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:15:33.359372 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7834d3a8-a113-4673-9898-8970a78a1119 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:33.621110 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:34.888320 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54702) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:35.066384 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8c6e1a0-6c22-4d9f-bcb3-28a79fb8a61a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:35.066781 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8c6e1a0-6c22-4d9f-bcb3-28a79fb8a61a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:35.067510 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-f8c6e1a0-6c22-4d9f-bcb3-28a79fb8a61a admin admin] Synchronizing usage tracker for tenant:96a8567604aa4b5d8645ca18159c6f3d on resource:network {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:15:35.180975 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-f8c6e1a0-6c22-4d9f-bcb3-28a79fb8a61a admin admin] Unset dirty status for tenant:96a8567604aa4b5d8645ca18159c6f3d on resource:network {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:15:35.182138 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-f8c6e1a0-6c22-4d9f-bcb3-28a79fb8a61a admin admin] 10.222.0.59 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.2928457
May 28 14:15:35.215529 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:15:37.302233 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54712) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:37.473399 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6ba7a9e-1f08-4fc0-b9ec-8084bdf4be22 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:37.473880 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6ba7a9e-1f08-4fc0-b9ec-8084bdf4be22 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:37.475582 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-d6ba7a9e-1f08-4fc0-b9ec-8084bdf4be22 admin admin] 10.222.0.59 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1722846
May 28 14:15:39.576906 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54722) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:39.748866 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70eca7c2-c906-4af2-8759-716cbd086927 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:39.750229 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-70eca7c2-c906-4af2-8759-716cbd086927 admin admin] 10.222.0.59 "GET /v2.0/networks/80ee4f6d-0818-4fa2-b445-f0cd3d16d800 HTTP/1.1" status: 200  len: 869 time: 0.1723859
May 28 14:15:41.868237 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54732) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:42.033620 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-339b56f4-3846-47a2-87ad-74fbfa7cf48b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:42.034956 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-339b56f4-3846-47a2-87ad-74fbfa7cf48b admin admin] 10.222.0.59 "GET /v2.0/networks/f203e1e9-7403-4723-8925-7d733bca2c40 HTTP/1.1" status: 200  len: 886 time: 0.1657140
May 28 14:15:44.164754 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54742) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:44.276189 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77d5cedf-5a60-40c7-be52-c826ef7fbf2c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:44.276649 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77d5cedf-5a60-40c7-be52-c826ef7fbf2c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:44.278164 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-77d5cedf-5a60-40c7-be52-c826ef7fbf2c admin admin] 10.222.0.59 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1124663
May 28 14:15:46.423533 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54752) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:46.547852 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3649a750-b1fc-40be-b024-6cdbecb4809a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:46.548301 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3649a750-b1fc-40be-b024-6cdbecb4809a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:46.549844 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-3649a750-b1fc-40be-b024-6cdbecb4809a admin admin] 10.222.0.59 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1252141
May 28 14:15:47.550855 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 5 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:15:48.690988 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54762) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:48.797601 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e02d32c4-92d7-48ed-8ac5-75c9be7ad524 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:48.798954 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-e02d32c4-92d7-48ed-8ac5-75c9be7ad524 admin admin] 10.222.0.59 "GET /v2.0/subnets/92b37249-6192-47f9-ac59-3e07c09a6d83 HTTP/1.1" status: 200  len: 868 time: 0.1068308
May 28 14:15:50.920392 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54772) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:15:51.024035 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0815753-fc8e-444e-8a7a-022b225e94bb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:15:51.025363 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-a0815753-fc8e-444e-8a7a-022b225e94bb admin admin] 10.222.0.59 "GET /v2.0/subnets/f0cd2108-42a0-4380-970f-9928591eb252 HTTP/1.1" status: 200  len: 816 time: 0.1040335
May 28 14:15:59.991815 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-742e73b2-bc4b-437d-9c4b-ecc327fba5a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:02.448899 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:02.477575 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6e36fb0c-b5b5-41a9-abfc-621303c7d981 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:03.615966 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:05.244183 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:14.174860 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54816) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:16:14.223600 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [None req-837276a2-2615-478f-95c6-1a943e3ebb07 admin admin] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92695) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:16:14.224583 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-837276a2-2615-478f-95c6-1a943e3ebb07 admin admin] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0487990
May 28 14:16:16.415144 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54826) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:16:16.482945 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.pecan_wsgi.hooks.translation [None req-d2eb771d-6a29-4223-9213-09dcaa518a6f admin admin] GET failed (client error): The resource could not be found.
May 28 14:16:16.484530 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-d2eb771d-6a29-4223-9213-09dcaa518a6f admin admin] 10.222.0.59 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0684171
May 28 14:16:16.610742 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5da07ac7-8961-4888-b76b-1f1057737127 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:16:16.612132 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5da07ac7-8961-4888-b76b-1f1057737127 admin admin] 10.222.0.59 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1237574
May 28 14:16:18.776362 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54836) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:16:18.825065 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:16:18.830601 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:16:18.842398 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:16:18.917434 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Made reservation on behalf of 96a8567604aa4b5d8645ca18159c6f3d for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:16:18.919891 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:19.011538 dv-cinder-791281-3-iscsi neutron-server[92695]: WARNING neutron.services.revisions.revision_plugin [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7fbba2334b20] {project_id='96a8567604aa4b5d8645ca18159c6f3d', id='14f53147-1f1b-49f3-88c8-6cada0ea3d24', target_tenant='*', action='access_as_shared', object_id='be1049d9-2ca0-4d9a-a34a-180226439569'}> to bump revision.
May 28 14:16:19.022409 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] vlan segment allocate from pool success with {'vlan_id': 892, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:16:19.030651 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:19.030980 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Added segment fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc of type vlan for network be1049d9-2ca0-4d9a-a34a-180226439569
May 28 14:16:19.055805 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:19.150636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:19.152001 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:16:19.152570 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:19.157198 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:16:19.254477 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Pushing event updated for resources: {'Network': ['ID=be1049d9-2ca0-4d9a-a34a-180226439569,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:16:19.257720 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:16:19.265278 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network be1049d9-2ca0-4d9a-a34a-180226439569 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:16:19.336082 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.5586193
May 28 14:16:21.514127 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54846) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:16:21.581291 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.pecan_wsgi.hooks.translation [None req-8cc66ba4-75fb-4908-9ef6-7570d9324d66 admin admin] GET failed (client error): The resource could not be found.
May 28 14:16:21.581801 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8cc66ba4-75fb-4908-9ef6-7570d9324d66 admin admin] Synchronizing usage tracker for tenant:96a8567604aa4b5d8645ca18159c6f3d on resource:network {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:16:21.677935 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8cc66ba4-75fb-4908-9ef6-7570d9324d66 admin admin] Unset dirty status for tenant:96a8567604aa4b5d8645ca18159c6f3d on resource:network {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:16:21.679086 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-8cc66ba4-75fb-4908-9ef6-7570d9324d66 admin admin] 10.222.0.59 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.1640236
May 28 14:16:21.784010 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f78215bc-31af-46ed-9967-b890ce3440a7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:16:21.785478 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-f78215bc-31af-46ed-9967-b890ce3440a7 admin admin] 10.222.0.59 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1024399
May 28 14:16:21.795455 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Request body: {'subnet': {'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'ip_version': 4, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:16:21.799829 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:16:21.804270 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Usage tracker for resource:subnet and tenant:96a8567604aa4b5d8645ca18159c6f3d is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:16:21.807279 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Quota usage for subnet was recalculated. Used quota:1. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:16:21.813124 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:16:21.934902 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Made reservation on behalf of 96a8567604aa4b5d8645ca18159c6f3d for: {'subnet': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:16:21.937221 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:22.523921 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:22.527706 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:16:22.596622 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=59d0de50-0964-4064-a674-a8b8b060b9b6,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:16:22.600415 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:16:22.610047 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Checking segment: {'id': 'fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:16:22.610413 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Network hostable DHCP agents. Network: be1049d9-2ca0-4d9a-a34a-180226439569, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92695) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:16:22.694702 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Network be1049d9-2ca0-4d9a-a34a-180226439569 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92695) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:16:22.803194 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, be1049d9-2ca0-4d9a-a34a-180226439569) {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:16:22.809760 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:16:22.810691 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:22.811803 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e806499-7ba9-465a-8a0f-704656992e76 None None] Network be1049d9-2ca0-4d9a-a34a-180226439569 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:16:22.964242 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.1720810
May 28 14:16:23.029582 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-be1049d9-2ca0-4d9a-a34a-180226439569', 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569', 'tenant_id': '96a8567604aa4b5d8645ca18159c6f3d', 'fixed_ips': [{'subnet_id': '59d0de50-0964-4064-a674-a8b8b060b9b6'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:16:23.030447 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:23.195461 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Allocated IP 192.168.233.2 (be1049d9-2ca0-4d9a-a34a-180226439569/59d0de50-0964-4064-a674-a8b8b060b9b6/d9820792-647c-4356-9da2-ffae1bc72f35) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:16:23.425029 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:23.436042 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Transition to ACTIVE for port object d9820792-647c-4356-9da2-ffae1bc72f35 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:16:23.454528 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Transition to ACTIVE for port object d9820792-647c-4356-9da2-ffae1bc72f35 will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:16:23.535607 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:23.542419 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:16:23.602818 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Network be1049d9-2ca0-4d9a-a34a-180226439569 is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:16:23.603984 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:16:23.607773 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:16:23.641521 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Pushing event updated for resources: {'Port': ['ID=d9820792-647c-4356-9da2-ffae1bc72f35,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:16:23.657643 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.658164 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.658281 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.658601 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.658922 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.659239 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.659573 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.659889 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.660232 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.660546 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.660864 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.661857 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:16:23.691036 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:16:23.717376 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Attempting to bind port d9820792-647c-4356-9da2-ffae1bc72f35 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:16:23.717741 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Attempting to bind port d9820792-647c-4356-9da2-ffae1bc72f35 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': 'fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:16:23.718097 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Attempting to bind port d9820792-647c-4356-9da2-ffae1bc72f35 on network be1049d9-2ca0-4d9a-a34a-180226439569 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:16:23.724232 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 16, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:16:23.724980 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Checking segment: {'id': 'fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:16:23.724980 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:23.725390 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Bound using segment: {'id': 'fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:16:23.725864 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Bound port: d9820792-647c-4356-9da2-ffae1bc72f35, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:16:23.726238 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:23.820912 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] For port d9820792-647c-4356-9da2-ffae1bc72f35, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:16:23.824416 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] For port d9820792-647c-4356-9da2-ffae1bc72f35, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=d9820792-647c-4356-9da2-ffae1bc72f35,segment=NetworkSegment(fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc),segment_id=fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:16:23.924603 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:23.928786 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:16:24.013180 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Pushing event updated for resources: {'Port': ['ID=d9820792-647c-4356-9da2-ffae1bc72f35,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:16:24.019437 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:16:24.476617 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device d9820792-647c-4356-9da2-ffae1bc72f35 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:16:24.549241 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 5 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:16:24.631909 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port d9820792-647c-4356-9da2-ffae1bc72f35 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:16:24.843090 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edd0784c-31d2-4a39-ae18-8a3072d234f7 None None] Network be1049d9-2ca0-4d9a-a34a-180226439569 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:16:25.011162 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-c62eca21-09d4-4ca2-b7a6-43a99f9e7887 None None] Provisioning for port d9820792-647c-4356-9da2-ffae1bc72f35 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:16:25.026913 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-c62eca21-09d4-4ca2-b7a6-43a99f9e7887 None None] Provisioning complete for port d9820792-647c-4356-9da2-ffae1bc72f35 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:16:25.027280 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c62eca21-09d4-4ca2-b7a6-43a99f9e7887 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:25.226380 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c62eca21-09d4-4ca2-b7a6-43a99f9e7887 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:25.264061 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-c62eca21-09d4-4ca2-b7a6-43a99f9e7887 None None] For port d9820792-647c-4356-9da2-ffae1bc72f35, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=d9820792-647c-4356-9da2-ffae1bc72f35,segment=NetworkSegment(fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc),segment_id=fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:16:25.357686 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c62eca21-09d4-4ca2-b7a6-43a99f9e7887 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:25.361252 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:16:25.429457 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c62eca21-09d4-4ca2-b7a6-43a99f9e7887 None None] Pushing event updated for resources: {'Port': ['ID=d9820792-647c-4356-9da2-ffae1bc72f35,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:16:25.432530 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-c62eca21-09d4-4ca2-b7a6-43a99f9e7887 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:16:25.479632 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-1965011e-1182-4f85-bdfa-9b151946beb3 None None] Provisioning complete for port d9820792-647c-4356-9da2-ffae1bc72f35 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:16:25.479953 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1965011e-1182-4f85-bdfa-9b151946beb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:26.446219 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device d9820792-647c-4356-9da2-ffae1bc72f35 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:16:26.515882 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port d9820792-647c-4356-9da2-ffae1bc72f35 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:16:26.516262 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:30.003538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a9537782-3e1a-4fca-a281-521c19947dea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:32.472024 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:32.500425 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-9945e83f-a426-4440-b77c-5decb19de66d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:33.649047 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:16:35.294808 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:00.020328 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-325e842a-647e-4b41-8526-0842bf258633 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:01.547309 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 5 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:17:02.477379 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:02.500029 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-712dff99-1a35-4916-887d-a9df68025b44 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:03.631491 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:05.243143 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:29.996771 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-26b185da-e2f1-4d47-9a7c-80395e599005 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:32.515829 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:32.568211 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-550a9336-ac3a-439a-8a01-ad017340bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:33.630866 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:35.282960 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:38.546000 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 5 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:17:45.809856 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54896) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:17:45.816628 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [None req-620cec0f-273b-4416-b3fe-d389281fed9a tempest-verify_tempest_config-1172283664 tempest-verify_tempest_config-1172283664-project] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92695) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:17:45.817568 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-620cec0f-273b-4416-b3fe-d389281fed9a tempest-verify_tempest_config-1172283664 tempest-verify_tempest_config-1172283664-project] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0067048
May 28 14:17:46.674322 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54914) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:17:46.796364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:46.813157 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:17:46.816938 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Usage tracker for resource:security_group_rule and tenant:f81ac0328b7d46e68e354a7b5a059070 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:17:46.819842 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:17:46.825406 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:17:46.905686 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:46.984637 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:46.992431 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:17:47.030675 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f327e02-3c04-4614-8887-98b9acf93be7,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:17:47.034736 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Synchronizing usage tracker for tenant:96a8567604aa4b5d8645ca18159c6f3d on resource:security_group {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:17:47.041940 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.042301 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.042636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.042960 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.043282 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.043638 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.043964 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.044280 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.044609 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.044923 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.045235 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.045543 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:17:47.051026 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:17:47.122063 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Unset dirty status for tenant:96a8567604aa4b5d8645ca18159c6f3d on resource:security_group {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:17:47.123330 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=f81ac0328b7d46e68e354a7b5a059070&name=default HTTP/1.1" status: 200  len: 2975 time: 0.4480636
May 28 14:17:47.125955 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54920) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:17:47.183582 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4aa28ca8-1e35-42c5-814f-9edbc8a70222 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:47.210094 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4aa28ca8-1e35-42c5-814f-9edbc8a70222 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:47.373824 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4aa28ca8-1e35-42c5-814f-9edbc8a70222 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:47.377806 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:17:47.392158 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa28ca8-1e35-42c5-814f-9edbc8a70222 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f327e02-3c04-4614-8887-98b9acf93be7,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:17:47.395636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-4aa28ca8-1e35-42c5-814f-9edbc8a70222 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:17:47.399215 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4aa28ca8-1e35-42c5-814f-9edbc8a70222 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:17:47.400323 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-4aa28ca8-1e35-42c5-814f-9edbc8a70222 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/9f327e02-3c04-4614-8887-98b9acf93be7 HTTP/1.1" status: 204  len: 168 time: 0.2734945
May 28 14:17:59.985435 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3dcbb5ef-a7a2-4086-b70b-095bfacdcf6f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:02.516661 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:02.561745 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-772233bb-1be1-407d-ba0e-27b58494852e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:03.647773 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:05.287991 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:15.545399 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 5 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:18:30.019346 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-5c600d37-174d-4a79-b9b3-a0832eac0719 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:32.498637 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:32.538494 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-cfbd10f9-55c1-466d-8d37-a3dc793f8908 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:33.630466 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:35.270686 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:18:52.544492 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 5 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:19:00.001750 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-761238a2-5dc3-44d9-a805-197138ab531a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:02.572858 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:02.606587 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f956045b-f274-419c-91b1-a91b9abe7dbc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:03.647051 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:05.240939 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:27.767125 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798'] for agent, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:29.543532 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:19:29.984113 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d42a1c37-65c9-45d7-8262-ff80822ba110 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:30.137503 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 54972) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:19:30.253356 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-80c06246-3ff1-45e4-bb37-e41329b3b225 admin admin] 10.222.0.59 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1147738
May 28 14:19:32.413220 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 54982) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:19:32.475485 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-fcdde6f2-4769-468f-8c17-aadc1d147e3c admin admin] 10.222.0.59 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0611961
May 28 14:19:32.533026 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:32.572615 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-e5b32f13-6ba4-4375-a1db-01d142915791 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:33.640863 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:35.292670 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:19:57.715167 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:00.007017 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1295cb50-057a-4c9f-923c-2be087a90fe1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:02.520974 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:02.555004 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b356b67d-7a38-4113-b3ea-fe76a727dc43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:03.657726 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:05.241583 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:06.542801 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:20:27.703874 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:30.035121 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-ae6278f4-ae7c-4b48-a081-f36c3c5f1c8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:32.509337 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:32.543626 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-546ec212-afb3-4902-93eb-b990a69273fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:33.651491 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:35.377841 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:20:43.542692 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:20:57.726744 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:00.023533 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-10bb7ea1-a534-4908-8d6e-e7cef0951d21 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:02.531383 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:02.571711 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-25cec767-f861-4439-a2b5-aa397593f3fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:02.999099 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55158) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:03.039778 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55168) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:03.200233 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1253964341-network', 'tenant_id': 'b354d77c0fbf46b7b8ada7c2d13e728d'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:03.205619 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:03.210103 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Usage tracker for resource:network and tenant:b354d77c0fbf46b7b8ada7c2d13e728d is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:03.213253 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:03.220261 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:03.235849 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-network', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:03.240880 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:03.244751 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Usage tracker for resource:network and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:03.250627 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:03.259163 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:03.359772 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Made reservation on behalf of b354d77c0fbf46b7b8ada7c2d13e728d for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:03.362175 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.374840 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.389933 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:03.393629 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Usage tracker for resource:security_group_rule and tenant:b354d77c0fbf46b7b8ada7c2d13e728d is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:03.396465 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:03.405535 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:03.408581 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Made reservation on behalf of 3bbdb80ac64d4db395d276876322e7b0 for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:03.410920 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.429869 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.456107 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:03.464671 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Usage tracker for resource:security_group_rule and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:03.469680 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:03.479779 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:03.567300 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.622985 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.662900 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.664254 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.666604 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:03.683724 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] vlan segment allocate from pool success with {'vlan_id': 873, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:21:03.706420 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.713639 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Added segment 7bc4f958-02da-463b-b30a-980772ce6b5e of type vlan for network 33423c84-4810-475b-9353-bb77585d5b4c
May 28 14:21:03.713639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5bf6616-5547-4d40-a0ea-b25f3b9f3b92,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:03.724577 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.724939 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.725297 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.725619 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.725975 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.726299 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.726611 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.726925 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.727253 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.727588 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.727895 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.728201 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Tracked resource versions report:
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]: pushed versions:
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]: {   'AddressGroup': {'1.2'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'ConntrackHelper': {'1.0'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Log': {'1.0'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Network': {'1.1'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Port': {'1.7'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'PortForwarding': {'1.2'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'QosPolicy': {'1.8'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'SecurityGroup': {'1.4'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'SecurityGroupRule': {'1.2'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'SubPort': {'1.0'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Subnet': {'1.1'},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     'Trunk': {'1.1'}}
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]: consumer versions:
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]: {   DHCP agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     HyperV agent@hv-cinder-79128: {},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     L3 agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     Metadata agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     Metering agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:     Open vSwitch agent@dv-cinder-791281-3-iscsi: {   'AddressGroup': '1.2',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'ConntrackHelper': '1.0',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Log': '1.0',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Network': '1.1',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Port': '1.7',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'PortForwarding': '1.2',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'QosPolicy': '1.8',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'SecurityGroup': '1.4',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'SecurityGroupRule': '1.2',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'SubPort': '1.0',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Subnet': '1.1',
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:                                                      'Trunk': '1.1'}}
May 28 14:21:03.729195 dv-cinder-791281-3-iscsi neutron-server[92695]:  {{(pid=92695) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 28 14:21:03.733837 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:03.744704 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55196) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:03.747261 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.759683 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-4aa28ca8-1e35-42c5-814f-9edbc8a70222 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:03.764316 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.794387 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] vlan segment allocate from pool success with {'vlan_id': 869, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:21:03.806416 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7affb313-fe4a-4430-8208-78a4fadec415,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:03.813988 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:03.822692 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.823338 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Added segment 98da8543-e1f7-4222-b523-eef6806a46f7 of type vlan for network 936c4847-d3d4-4250-b543-dc72dd308858
May 28 14:21:03.850780 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.932167 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.933487 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:03.934066 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:03.939203 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ee0ed623-78e7-45c9-bbeb-4311487ee119 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:04.043035 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.046100 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Pushing event updated for resources: {'Network': ['ID=33423c84-4810-475b-9353-bb77585d5b4c,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:04.051074 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:04.051781 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.058173 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:04.058640 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:04.062770 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 33423c84-4810-475b-9353-bb77585d5b4c details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:21:04.150260 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Pushing event updated for resources: {'Network': ['ID=936c4847-d3d4-4250-b543-dc72dd308858,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:04.161631 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55216) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:04.167829 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Request body: {'subnet': {'network_id': '33423c84-4810-475b-9353-bb77585d5b4c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1253964341-subnet', 'tenant_id': 'b354d77c0fbf46b7b8ada7c2d13e728d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:04.172919 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 1.1726251
May 28 14:21:04.176474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:04.178220 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:04.183881 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Usage tracker for resource:subnet and tenant:b354d77c0fbf46b7b8ada7c2d13e728d is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:04.186866 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:04.192875 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:04.208304 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 936c4847-d3d4-4250-b543-dc72dd308858 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:21:04.249772 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55222) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:04.257836 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 890 time: 1.2168007
May 28 14:21:04.265480 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55228) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:04.284757 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Request body: {'subnet': {'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-subnet', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:04.288105 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-network', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:04.294562 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:04.299933 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Made reservation on behalf of b354d77c0fbf46b7b8ada7c2d13e728d for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:04.307723 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Usage tracker for resource:subnet and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:04.307982 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.308902 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:04.318047 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:04.329195 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:04.390242 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Usage tracker for resource:network and tenant:71fbb9d6a3b643238579cd1698ca83e1 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:04.395735 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:04.404517 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:04.405762 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Made reservation on behalf of 3bbdb80ac64d4db395d276876322e7b0 for: {'subnet': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:04.408681 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.495531 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Made reservation on behalf of 71fbb9d6a3b643238579cd1698ca83e1 for: {'network': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:04.497905 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.554234 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.569723 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:04.574766 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Usage tracker for resource:security_group_rule and tenant:71fbb9d6a3b643238579cd1698ca83e1 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:04.579237 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:04.586708 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:04.644868 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-731471033-network', 'tenant_id': '99ce685b86cb47abba407b2e49dcf373'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:04.660466 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:04.670861 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Usage tracker for resource:network and tenant:99ce685b86cb47abba407b2e49dcf373 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:04.681467 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:04.701366 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:04.810508 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.818447 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Made reservation on behalf of 99ce685b86cb47abba407b2e49dcf373 for: {'network': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:04.820823 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.835049 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.860035 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:04.865644 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Usage tracker for resource:security_group_rule and tenant:99ce685b86cb47abba407b2e49dcf373 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:04.869550 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:04.877246 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:04.921059 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.942012 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] vlan segment allocate from pool success with {'vlan_id': 850, 'physical_network': 'physnet1'}  {{(pid=92694) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:21:04.954080 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8777742722789', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:04.954664 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fbba3ca6e50> segment precommit_create {{(pid=92694) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 28 14:21:04.955132 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.segments_db [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Added segment ceb4fcf2-0e82-4e08-b47f-4114a006cbb3 of type vlan for network 1145a91e-035d-40fe-813b-06d960bbe8ad
May 28 14:21:04.964601 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:05.008157 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.013550 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-bd97d1c3-b56c-4f85-a027-5fbdf44918b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:05.072088 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a33b117b-9151-4e0d-a39e-2f027719309f,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:05.084056 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:05.116592 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Checking segment: {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:05.116934 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Network hostable DHCP agents. Network: 936c4847-d3d4-4250-b543-dc72dd308858, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92695) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:21:05.146326 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.150184 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7540dcc9-66fd-4ce4-a5e7-2759de1432be,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:05.178849 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.179402 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.179820 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.180329 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.180738 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.181656 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.182295 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.182908 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.183644 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.184700 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.185329 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.185871 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Tracked resource versions report:
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]: pushed versions:
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]: {   'AddressGroup': {'1.2'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'ConntrackHelper': {'1.0'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Log': {'1.0'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Network': {'1.1'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Port': {'1.7'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'PortForwarding': {'1.2'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'QosPolicy': {'1.8'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'SecurityGroup': {'1.4'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'SecurityGroupRule': {'1.2'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'SubPort': {'1.0'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Subnet': {'1.1'},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     'Trunk': {'1.1'}}
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]: consumer versions:
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]: {   DHCP agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     HyperV agent@hv-cinder-79128: {},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     L3 agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     Metadata agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     Metering agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:     Open vSwitch agent@dv-cinder-791281-3-iscsi: {   'AddressGroup': '1.2',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'ConntrackHelper': '1.0',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Log': '1.0',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Network': '1.1',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Port': '1.7',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'PortForwarding': '1.2',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'QosPolicy': '1.8',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'SecurityGroup': '1.4',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'SecurityGroupRule': '1.2',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'SubPort': '1.0',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Subnet': '1.1',
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:                                                      'Trunk': '1.1'}}
May 28 14:21:05.187098 dv-cinder-791281-3-iscsi neutron-server[92694]:  {{(pid=92694) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 28 14:21:05.206935 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:05.223138 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.240456 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Network 936c4847-d3d4-4250-b543-dc72dd308858 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92695) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:21:05.248212 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:05.274722 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.310396 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.345236 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b394dc96-31cf-407c-ad15-859ef4f1ab40,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:05.348867 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:05.355606 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Checking segment: {'id': '7bc4f958-02da-463b-b30a-980772ce6b5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '33423c84-4810-475b-9353-bb77585d5b4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:05.355969 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Network hostable DHCP agents. Network: 33423c84-4810-475b-9353-bb77585d5b4c, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:21:05.377389 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 936c4847-d3d4-4250-b543-dc72dd308858) {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:05.382771 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:05.383361 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.390954 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a0bb4e8-ef83-46f9-bcb4-4dac47b23073 None None] Network 936c4847-d3d4-4250-b543-dc72dd308858 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:05.549405 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.551050 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:05.551919 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.559366 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:05.583761 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 853 time: 1.3121486
May 28 14:21:05.586124 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55266) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:05.591875 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:05.602135 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:05.609823 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Usage tracker for resource:router and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:05.615292 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-936c4847-d3d4-4250-b543-dc72dd308858', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:21:05.616781 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:05.616898 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.623086 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:05.673708 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Pushing event updated for resources: {'Network': ['ID=1145a91e-035d-40fe-813b-06d960bbe8ad,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:05.678701 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.679408 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Network 33423c84-4810-475b-9353-bb77585d5b4c is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:21:05.687267 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 33423c84-4810-475b-9353-bb77585d5b4c) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:05.703900 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:05.706302 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 1145a91e-035d-40fe-813b-06d960bbe8ad details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:21:05.709080 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.714261 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.714479 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:05.736229 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.774242 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] vlan segment allocate from pool success with {'vlan_id': 887, 'physical_network': 'physnet1'}  {{(pid=92694) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:21:05.785551 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:05.786270 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.790875 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:05.802539 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3981209-d2c6-4223-adf2-2cfe6f3dec88 None None] Network 33423c84-4810-475b-9353-bb77585d5b4c requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:05.806165 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.806165 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.segments_db [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Added segment 5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811 of type vlan for network 91ebc16a-e9fa-40de-8d8f-6fe4965dc314
May 28 14:21:05.806165 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:05.837488 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.932725 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 1.7699730
May 28 14:21:05.937727 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 2.1920357
May 28 14:21:05.938645 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55284) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:05.945064 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Request body: {'subnet': {'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-subnet', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:05.961658 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:05.979022 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Usage tracker for resource:subnet and tenant:71fbb9d6a3b643238579cd1698ca83e1 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:05.981987 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.983148 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:05.986586 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:05.987236 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:05.999467 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Allocated IP 172.20.0.2 (936c4847-d3d4-4250-b543-dc72dd308858/a33b117b-9151-4e0d-a39e-2f027719309f/62bcf3bb-40c5-4ec7-b933-6b748b550d19) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:06.003215 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-eb90e670-8b74-459f-a4b8-b7487b3ba167 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:06.035320 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:06.164557 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1c26b76-b71a-41cb-8643-a5f0be59c6b1 None None] Network 33423c84-4810-475b-9353-bb77585d5b4c requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:06.175153 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Made reservation on behalf of 71fbb9d6a3b643238579cd1698ca83e1 for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:06.177677 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Notify callbacks [] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:06.250331 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Pushing event updated for resources: {'Network': ['ID=91ebc16a-e9fa-40de-8d8f-6fe4965dc314,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:06.272926 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 2.0219738
May 28 14:21:06.275714 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.273s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:06.278354 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55292) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:06.290424 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Request body: {'subnet': {'network_id': '91ebc16a-e9fa-40de-8d8f-6fe4965dc314', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-731471033-subnet', 'tenant_id': '99ce685b86cb47abba407b2e49dcf373', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:06.291204 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 91ebc16a-e9fa-40de-8d8f-6fe4965dc314 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:21:06.300330 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:06.308673 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Usage tracker for resource:subnet and tenant:99ce685b86cb47abba407b2e49dcf373 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:06.314221 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:06.326956 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:06.552295 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Made reservation on behalf of 99ce685b86cb47abba407b2e49dcf373 for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:06.572679 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:06.623137 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:06.669090 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:06.687521 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Transition to ACTIVE for port object 62bcf3bb-40c5-4ec7-b933-6b748b550d19 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:06.736334 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Transition to ACTIVE for port object 62bcf3bb-40c5-4ec7-b933-6b748b550d19 will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:06.836045 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:06.853417 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-2317f492-7d84-4987-99ed-e0ff35910364 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:07.022648 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Pushing event updated for resources: {'Port': ['ID=62bcf3bb-40c5-4ec7-b933-6b748b550d19,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:07.033349 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.033349 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.036538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Tracked resource versions report:
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]: pushed versions:
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]: {   'AddressGroup': {'1.2'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'ConntrackHelper': {'1.0'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Log': {'1.0'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Network': {'1.1'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Port': {'1.7'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'PortForwarding': {'1.2'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'QosPolicy': {'1.8'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'SecurityGroup': {'1.4'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'SecurityGroupRule': {'1.2'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'SubPort': {'1.0'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Subnet': {'1.1'},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     'Trunk': {'1.1'}}
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]: consumer versions:
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]: {   DHCP agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     HyperV agent@hv-cinder-79128: {},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     L3 agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     Metadata agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     Metering agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:     Open vSwitch agent@dv-cinder-791281-3-iscsi: {   'AddressGroup': '1.2',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'ConntrackHelper': '1.0',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Log': '1.0',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Network': '1.1',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Port': '1.7',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'PortForwarding': '1.2',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'QosPolicy': '1.8',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'SecurityGroup': '1.4',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'SecurityGroupRule': '1.2',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'SubPort': '1.0',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Subnet': '1.1',
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:                                                      'Trunk': '1.1'}}
May 28 14:21:07.038116 dv-cinder-791281-3-iscsi neutron-server[92696]:  {{(pid=92696) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 28 14:21:07.045058 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:07.059463 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Network 936c4847-d3d4-4250-b543-dc72dd308858 is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:07.061550 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:07.075819 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:07.156915 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.189409 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.293951 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.314677 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:07.370568 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Allocated IP 172.27.3.30 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/06123ab5-7778-4ce3-914e-df22dfe564c6) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:07.404918 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Attempting to bind port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:21:07.405548 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Attempting to bind port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:21:07.405667 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Attempting to bind port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 on network 936c4847-d3d4-4250-b543-dc72dd308858 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:07.411597 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Pushing event updated for resources: {'Subnet': ['ID=741b5b05-e852-43d4-a973-49d123a472b9,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:07.415546 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 21, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:21:07.415546 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Checking segment: {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:07.415899 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.416464 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Bound using segment: {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:21:07.417447 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Bound port: 62bcf3bb-40c5-4ec7-b933-6b748b550d19, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:21:07.417715 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.423322 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:07.435710 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Checking segment: {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:07.436074 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Network hostable DHCP agents. Network: 1145a91e-035d-40fe-813b-06d960bbe8ad, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:21:07.509368 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.514328 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2afa5146-f858-4d78-b107-9ca9c9c1cc49 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:07.532298 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.618438 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Network 1145a91e-035d-40fe-813b-06d960bbe8ad is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:21:07.623951 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] For port 62bcf3bb-40c5-4ec7-b933-6b748b550d19, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:21:07.631292 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] For port 62bcf3bb-40c5-4ec7-b933-6b748b550d19, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=62bcf3bb-40c5-4ec7-b933-6b748b550d19,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:21:07.639496 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c8e92692-f94e-42ef-9b0b-7db259ad1468,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:07.642043 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Checking segment: {'id': '5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': '91ebc16a-e9fa-40de-8d8f-6fe4965dc314'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:07.642215 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Network hostable DHCP agents. Network: 91ebc16a-e9fa-40de-8d8f-6fe4965dc314, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:21:07.645156 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:07.647139 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.654422 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:07.715912 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:07.718688 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:07.722341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:07.755072 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.757737 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 1145a91e-035d-40fe-813b-06d960bbe8ad) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:07.761288 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:07.768606 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:07.768606 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.792401 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Pushing event updated for resources: {'Port': ['ID=06123ab5-7778-4ce3-914e-df22dfe564c6,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:07.804023 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b6f4692-2871-44d0-86a6-7af42e7e652f None None] Network 1145a91e-035d-40fe-813b-06d960bbe8ad requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:07.853049 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:07.853890 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Network 91ebc16a-e9fa-40de-8d8f-6fe4965dc314 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:21:07.869892 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 91ebc16a-e9fa-40de-8d8f-6fe4965dc314) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:07.878692 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:07.879442 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:07.927616 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 856 time: 1.9873903
May 28 14:21:07.930891 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55334) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:07.937221 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:07.951654 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:07.957232 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Usage tracker for resource:router and tenant:71fbb9d6a3b643238579cd1698ca83e1 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:07.964091 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:07.979895 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:07.983519 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a163c135-c4f9-4e75-999a-8d6bc9b9ed75 None None] Network 91ebc16a-e9fa-40de-8d8f-6fe4965dc314 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:08.004318 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55340) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:08.012239 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1316753228-network', 'tenant_id': 'f57c5a8309a24ebbb0d81c7580b48fcf'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:08.022394 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-28e8c0f7-58ea-4116-be4c-def264893923 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 1.7381425
May 28 14:21:08.024383 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:08.040635 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Usage tracker for resource:network and tenant:f57c5a8309a24ebbb0d81c7580b48fcf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:08.049855 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:08.066211 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:08.166202 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:08.167825 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:08.186316 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Pushing event updated for resources: {'Port': ['ID=62bcf3bb-40c5-4ec7-b933-6b748b550d19,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:08.214399 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.453s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:08.219390 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:08.351099 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Made reservation on behalf of f57c5a8309a24ebbb0d81c7580b48fcf for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:08.353872 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:08.435304 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:08.507466 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:08.615366 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfd8b983-e87b-4fbd-bacb-bd0b015de356 None None] Network 91ebc16a-e9fa-40de-8d8f-6fe4965dc314 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:08.841093 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 62bcf3bb-40c5-4ec7-b933-6b748b550d19 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:08.842750 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Usage tracker for resource:security_group_rule and tenant:f57c5a8309a24ebbb0d81c7580b48fcf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:08.853628 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:08.880589 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:08.930072 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:08.968857 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09182e15-7682-4274-a78e-80f8ca517f73 None None] Network 1145a91e-035d-40fe-813b-06d960bbe8ad requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:09.298603 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:09.333484 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:09.438933 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:09.499510 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:09.561088 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60ef34b5-33d7-4748-b08b-de3f2fba0039 None None] Network 936c4847-d3d4-4250-b543-dc72dd308858 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:09.637625 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:09.672072 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] vlan segment allocate from pool success with {'vlan_id': 866, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:21:09.675259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:09.675993 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Added segment ae471620-a841-49d6-902b-c4e596986904 of type vlan for network 6983252e-f6f5-4128-ae62-287cd55d6fc1
May 28 14:21:09.705371 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:09.722156 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:09.728676 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55392) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:09.861849 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f88049b5-87c9-4ca2-ae17-886ebfe9b4e6,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:09.869716 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:09.899519 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-6e40df3c-37bc-438f-8b45-8996571cf523 None None] Provisioning for port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:09.915502 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-6e40df3c-37bc-438f-8b45-8996571cf523 None None] Provisioning complete for port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:09.916181 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6e40df3c-37bc-438f-8b45-8996571cf523 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:09.971422 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.013623 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.024918 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.028365 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.063856 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:10.066392 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.083649 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-986dc161-9512-4c25-b0ae-af6279fede1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:10.131042 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6e40df3c-37bc-438f-8b45-8996571cf523 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.137577 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55414) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:10.144870 dv-cinder-791281-3-iscsi neutron-server[92694]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 28 14:21:10.151515 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Router 93611a0c-a5d3-438a-bf94-7453623f231d is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92695) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:21:10.177477 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:10.204034 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Usage tracker for resource:security_group_rule and tenant:578b9c6cf59046ed86f271387ccedc71 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:10.216949 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:10.232494 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-6e40df3c-37bc-438f-8b45-8996571cf523 None None] For port 62bcf3bb-40c5-4ec7-b933-6b748b550d19, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=62bcf3bb-40c5-4ec7-b933-6b748b550d19,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:10.291630 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:10.337963 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6e40df3c-37bc-438f-8b45-8996571cf523 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.343820 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:10.387998 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 2.3820248
May 28 14:21:10.400960 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55426) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:10.415353 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Request body: {'subnet': {'network_id': '6983252e-f6f5-4128-ae62-287cd55d6fc1', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1316753228-subnet', 'tenant_id': 'f57c5a8309a24ebbb0d81c7580b48fcf', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:10.419022 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Pushing event updated for resources: {'Network': ['ID=6983252e-f6f5-4128-ae62-287cd55d6fc1,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:10.426669 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.343s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:10.435526 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:10.441685 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98a24f30-a8a2-429d-909a-315071350179 req-073262c3-1729-4eb9-8c42-48b82e781e84 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:10.442398 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-98a24f30-a8a2-429d-909a-315071350179 req-073262c3-1729-4eb9-8c42-48b82e781e84 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Synchronizing usage tracker for tenant:99ce685b86cb47abba407b2e49dcf373 on resource:network {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:10.447801 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 6983252e-f6f5-4128-ae62-287cd55d6fc1 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:21:10.465281 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Allocated IP 172.27.3.155 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/71ca7b78-f58e-42f2-b5dc-e78d77a8801c) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:10.510427 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Usage tracker for resource:subnet and tenant:f57c5a8309a24ebbb0d81c7580b48fcf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:10.516800 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:10.531071 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:10.560620 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:21:10.579808 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Sync routers for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:21:10.589752 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-27dad296-db0c-472b-b08f-fc92049b820a None None] Provisioning complete for port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:10.589971 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-27dad296-db0c-472b-b08f-fc92049b820a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.594757 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:21:10.595782 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba282b100>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:21:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:10.622042 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e40df3c-37bc-438f-8b45-8996571cf523 None None] Pushing event updated for resources: {'Port': ['ID=62bcf3bb-40c5-4ec7-b933-6b748b550d19,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:10.631532 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.637701 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-6e40df3c-37bc-438f-8b45-8996571cf523 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.294s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:10.655646 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.702760 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Made reservation on behalf of f57c5a8309a24ebbb0d81c7580b48fcf for: {'subnet': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:10.705288 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.785025 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.785596 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.790095 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 928 time: 5.1995440
May 28 14:21:10.790347 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55430) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:10.799451 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:10.801773 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:21:10.855926 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:10.868557 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:10.870912 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=578b9c6cf59046ed86f271387ccedc71&name=default HTTP/1.1" status: 200  len: 2975 time: 1.1354146
May 28 14:21:10.873764 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55434) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:10.879496 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52f955cb-2662-470c-9ada-5df5d6612f9d,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:10.894193 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:10.906812 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-98a24f30-a8a2-429d-909a-315071350179 req-073262c3-1729-4eb9-8c42-48b82e781e84 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Unset dirty status for tenant:99ce685b86cb47abba407b2e49dcf373 on resource:network {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:10.913619 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-073262c3-1729-4eb9-8c42-48b82e781e84 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/networks?id=91ebc16a-e9fa-40de-8d8f-6fe4965dc314 HTTP/1.1" status: 200  len: 811 time: 0.7732551
May 28 14:21:10.962055 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-c559a0fc-364c-403d-a2cf-20101893b0e9 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/quotas/99ce685b86cb47abba407b2e49dcf373 HTTP/1.1" status: 200  len: 375 time: 0.0474916
May 28 14:21:11.015413 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:11.029813 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-ee2f11a1-fd36-4886-8e57-a1af43b84d12 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=99ce685b86cb47abba407b2e49dcf373&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0668464
May 28 14:21:11.033978 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:11.038222 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-29acc628-a947-4fe3-aa4d-474086b1b8c4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:11.071871 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-29acc628-a947-4fe3-aa4d-474086b1b8c4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:11.089389 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:11.241135 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Pushing event updated for resources: {'Port': ['ID=71ca7b78-f58e-42f2-b5dc-e78d77a8801c,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:11.268047 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba282b100>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:07Z', 'revision_number': 3, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:11.273478 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Checking router: 93611a0c-a5d3-438a-bf94-7453623f231d for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:21:11.274148 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Updating router 93611a0c-a5d3-438a-bf94-7453623f231d port 06123ab5-7778-4ce3-914e-df22dfe564c6 binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:21:11.297766 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-29acc628-a947-4fe3-aa4d-474086b1b8c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:11.299628 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-c1b4ded9-9bbc-4286-83d8-170038d5b5de service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92694) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:21:11.306762 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-c1b4ded9-9bbc-4286-83d8-170038d5b5de service neutron] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0953474
May 28 14:21:11.320550 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.452s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:11.323725 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cfbf1033-1cd1-4533-a527-a8629b28fefb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:11.363730 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:11.519605 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29acc628-a947-4fe3-aa4d-474086b1b8c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52f955cb-2662-470c-9ada-5df5d6612f9d,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:11.534690 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-29acc628-a947-4fe3-aa4d-474086b1b8c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:11.546152 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-29acc628-a947-4fe3-aa4d-474086b1b8c4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:11.549782 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-29acc628-a947-4fe3-aa4d-474086b1b8c4 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/52f955cb-2662-470c-9ada-5df5d6612f9d HTTP/1.1" status: 204  len: 168 time: 0.6724842
May 28 14:21:11.695218 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:11.702617 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-078b4a47-121f-4080-9c4a-b913f1ece5e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:11.782052 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Pushing event updated for resources: {'Subnet': ['ID=808409cc-59b4-4968-9d2c-3b30b9fe8243,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:11.784362 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-3b32dc0b-0b3c-4e4b-a66c-7c4a2a45addd service neutron] 10.222.0.59 "GET /v2.0/networks/91ebc16a-e9fa-40de-8d8f-6fe4965dc314?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4767954
May 28 14:21:11.790901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:11.794928 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Checking segment: {'id': 'ae471620-a841-49d6-902b-c4e596986904', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '6983252e-f6f5-4128-ae62-287cd55d6fc1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:11.794928 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Network hostable DHCP agents. Network: 6983252e-f6f5-4128-ae62-287cd55d6fc1, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92695) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:21:11.840991 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:11.853174 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Transition to ACTIVE for port object 06123ab5-7778-4ce3-914e-df22dfe564c6 will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:11.908778 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Network 6983252e-f6f5-4128-ae62-287cd55d6fc1 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92695) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:21:11.937645 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:11.942297 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:12.005959 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 6983252e-f6f5-4128-ae62-287cd55d6fc1) {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:12.011820 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:12.012626 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.017369 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-147ee07c-d0bd-4b11-adad-47cb11f14482 None None] Network 6983252e-f6f5-4128-ae62-287cd55d6fc1 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:12.025423 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Attempting to bind port 06123ab5-7778-4ce3-914e-df22dfe564c6 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:21:12.025794 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Attempting to bind port 06123ab5-7778-4ce3-914e-df22dfe564c6 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:21:12.026144 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Attempting to bind port 06123ab5-7778-4ce3-914e-df22dfe564c6 on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:12.029710 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Pushing event updated for resources: {'Port': ['ID=06123ab5-7778-4ce3-914e-df22dfe564c6,revision_number=2']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:12.034776 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 21, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:21:12.035143 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:12.035539 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.035961 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:21:12.036432 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Bound port: 06123ab5-7778-4ce3-914e-df22dfe564c6, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:21:12.036801 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.069984 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.070365 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.070636 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.071076 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.071395 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.071756 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.072069 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.072382 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.072709 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.073022 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.073447 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.073640 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Tracked resource versions report:
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]: pushed versions:
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]: {   'AddressGroup': {'1.2'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'ConntrackHelper': {'1.0'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Log': {'1.0'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Network': {'1.1'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Port': {'1.7'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'PortForwarding': {'1.2'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'QosPolicy': {'1.8'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'SecurityGroup': {'1.4'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'SecurityGroupRule': {'1.2'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'SubPort': {'1.0'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Subnet': {'1.1'},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     'Trunk': {'1.1'}}
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]: consumer versions:
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]: {   DHCP agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     HyperV agent@hv-cinder-79128: {},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     L3 agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     Metadata agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     Metering agent@dv-cinder-791281-3-iscsi: {},
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:     Open vSwitch agent@dv-cinder-791281-3-iscsi: {   'AddressGroup': '1.2',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'ConntrackHelper': '1.0',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Log': '1.0',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Network': '1.1',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Port': '1.7',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'PortForwarding': '1.2',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'QosPolicy': '1.8',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'SecurityGroup': '1.4',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'SecurityGroupRule': '1.2',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'SubPort': '1.0',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Subnet': '1.1',
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:                                                      'Trunk': '1.1'}}
May 28 14:21:12.074604 dv-cinder-791281-3-iscsi neutron-server[92697]:  {{(pid=92697) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 28 14:21:12.082921 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:12.097917 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.144165 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 1.7419598
May 28 14:21:12.151605 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] For port 06123ab5-7778-4ce3-914e-df22dfe564c6, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:21:12.157703 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] For port 06123ab5-7778-4ce3-914e-df22dfe564c6, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=06123ab5-7778-4ce3-914e-df22dfe564c6,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:21:12.252437 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.257419 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:12.281680 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14c9228b-c3a2-4cd4-9084-feda964c0fa7 None None] Network 6983252e-f6f5-4128-ae62-287cd55d6fc1 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:12.347764 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:21:12.348475 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba282b100>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:21:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:12.373816 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55472) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:12.403105 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Pushing event updated for resources: {'Port': ['ID=06123ab5-7778-4ce3-914e-df22dfe564c6,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:12.413344 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:12.442980 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-fb1149fc-deb6-42f4-8049-f8b087227758 admin admin] Deleting subnet b394dc96-31cf-407c-ad15-859ef4f1ab40 {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:21:12.446237 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fb1149fc-deb6-42f4-8049-f8b087227758 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.476721 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-037b360d-b3d9-42de-88f7-58cf4b46507e service neutron] 10.222.0.59 "GET /v2.0/networks/91ebc16a-e9fa-40de-8d8f-6fe4965dc314?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6746867
May 28 14:21:12.569476 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fb1149fc-deb6-42f4-8049-f8b087227758 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.579759 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fb1149fc-deb6-42f4-8049-f8b087227758 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.676276 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55490) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:12.687154 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 62bcf3bb-40c5-4ec7-b933-6b748b550d19 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:12.752722 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.767126 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:21:12.796018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:12.804404 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Usage tracker for resource:security_group_rule and tenant:28d8c5ad7cad48c19483a9b477417544 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:12.812582 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:12.828786 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:12.903293 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:12.903693 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:12.956627 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55506) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:13.028581 dv-cinder-791281-3-iscsi neutron-server[92695]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 28 14:21:13.137714 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:13.169853 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fae17424-9879-4e60-9430-de15d9f863b5 req-31588c34-1e9a-4f36-bec2-4af8b4c29b62 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.2115147
May 28 14:21:13.215665 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:13.319823 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba282b100>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:07Z', 'revision_number': 3, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:13.327936 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53d3b06b-3b89-4519-ab2a-fc2d915b88c5 None None] The sync data for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi is: [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:07Z', 'revision_number': 3, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:21:13.328429 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:13.348152 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:13.352699 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1c58ce65-8316-4077-9430-6d5206e83aac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:13.407275 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=28d8c5ad7cad48c19483a9b477417544&name=default HTTP/1.1" status: 200  len: 2975 time: 0.7276824
May 28 14:21:13.413806 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55520) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:13.414613 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a206a05c-0a19-49a8-a866-706b8167ad67,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:13.419638 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:13.423597 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fb1149fc-deb6-42f4-8049-f8b087227758 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:13.478625 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:13.515886 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fb1149fc-deb6-42f4-8049-f8b087227758 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:13.522861 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb1149fc-deb6-42f4-8049-f8b087227758 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b394dc96-31cf-407c-ad15-859ef4f1ab40,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:13.525593 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fb1149fc-deb6-42f4-8049-f8b087227758 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:13.558162 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-19700020-3ad1-43b1-abcc-69996c905b94 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:13.562152 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-fb1149fc-deb6-42f4-8049-f8b087227758 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/b394dc96-31cf-407c-ad15-859ef4f1ab40 HTTP/1.1" status: 204  len: 168 time: 1.1873260
May 28 14:21:13.569649 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55532) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:13.616456 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-19700020-3ad1-43b1-abcc-69996c905b94 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:13.709686 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Allocated IP 172.20.0.1 (936c4847-d3d4-4250-b543-dc72dd308858/a33b117b-9151-4e0d-a39e-2f027719309f/376cfe1f-23f1-4d2e-a93c-9a98a3effcca) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:13.719043 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92694) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:21:13.827351 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:13.996634 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-19700020-3ad1-43b1-abcc-69996c905b94 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.017303 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-4abc6865-ff33-49af-9431-c40582f5b995 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:14.040233 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.049538 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19700020-3ad1-43b1-abcc-69996c905b94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a206a05c-0a19-49a8-a866-706b8167ad67,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:14.055343 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-19700020-3ad1-43b1-abcc-69996c905b94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:14.058274 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-19700020-3ad1-43b1-abcc-69996c905b94 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.059398 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-19700020-3ad1-43b1-abcc-69996c905b94 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/a206a05c-0a19-49a8-a866-706b8167ad67 HTTP/1.1" status: 204  len: 168 time: 0.6386867
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fbba2323460>> segment before_delete 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fbba2323460>> subnet precommit_delete_associations 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba2342430>> segment_host_mapping after_create 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba2342430>> port after_create 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba2342430>> port after_delete 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba2342430>> port after_update 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba2342430>> segment after_delete 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba2342430>> subnet after_create 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba2342430>> subnet after_delete 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.082814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba2342430>> subnet after_update 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.248500 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:21:14.260146 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Sync routers for ids ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:21:14.274959 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Routers {'8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:21:14.277034 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba270ed60>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:21:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:14.296445 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fbba213d880>> subnet after_create 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.296739 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fbba213d880>> subnet after_delete 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.297068 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fbba213d880>> subnet before_create 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.297399 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fbba213d880>> subnet before_update 55550000 {{(pid=92695) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:21:14.298026 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba2323160>,) {'filters': {'network_id': ['33423c84-4810-475b-9353-bb77585d5b4c']}} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:14.344828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.354725 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba2323160>, '7bc4f958-02da-463b-b30a-980772ce6b5e') {'for_net_delete': True} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:14.355024 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba2323160>, '7bc4f958-02da-463b-b30a-980772ce6b5e') {} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:14.363985 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b8363d25-7698-41ca-b9b8-3da0db2ee289 req-0aa3f626-0c5c-4e1d-9715-eea0808ce890 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0535452
May 28 14:21:14.366398 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.provisioning_blocks [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Transition to ACTIVE for port object 376cfe1f-23f1-4d2e-a93c-9a98a3effcca will not be triggered until provisioned by entity DHCP. {{(pid=92694) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:14.375438 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1610771'] for segment, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.410105 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.419741 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Releasing vlan 873 on physical network physnet1 to pool {{(pid=92695) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:21:14.420201 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1697792'] for segment, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   from cryptography.utils import int_from_bytes
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   from cryptography.utils import int_from_bytes
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]: Traceback (most recent call last):
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     timer()
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     cb(*args, **kw)
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     return func(*args, **kwargs)
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     self._notify()
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     self.callback(batched_events)
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     event.method(event)
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     return f(self, *a, **k)
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._get(url).json()
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self.request(url, 'GET', **kwargs)
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:21:14.437403 dv-cinder-791281-3-iscsi neutron-server[92695]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:21:14.463169 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Notify callbacks [] for router, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.465910 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 931 time: 6.5334539
May 28 14:21:14.468775 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55564) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:14.525249 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Set router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:21:14.549701 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.575144 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-53336d46-5bbb-4360-8e0c-ba1b40e02f14 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:14.632821 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Network 936c4847-d3d4-4250-b543-dc72dd308858 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:14.634632 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.639021 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-de418ce5-306b-4b8c-bcdf-ea741e4ab7d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:14.644139 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:14.646502 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:14.647512 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.658167 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.665947 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Pushing event deleted for resources: {'Network': ['ID=33423c84-4810-475b-9353-bb77585d5b4c,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:14.672669 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:14.679598 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] 10.222.0.59 "DELETE /v2.0/networks/33423c84-4810-475b-9353-bb77585d5b4c HTTP/1.1" status: 204  len: 168 time: 1.1070256
May 28 14:21:14.681693 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55572) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:14.718283 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 06123ab5-7778-4ce3-914e-df22dfe564c6 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:14.807930 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] Deleting subnet 808409cc-59b4-4968-9d2c-3b30b9fe8243 {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:21:14.815846 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:14.948649 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1610776'] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.032222 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.072706 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba270ed60>, [{'id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155'}], 'enable_snat': True}, 'gw_port_id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:08Z', 'updated_at': '2021-05-28T14:21:11Z', 'revision_number': 3, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'gw_port': {'id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:7a:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:10Z', 'updated_at': '2021-05-28T14:21:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:15.076983 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 06123ab5-7778-4ce3-914e-df22dfe564c6 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:15.084827 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 06123ab5-7778-4ce3-914e-df22dfe564c6 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:15.085388 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.209144 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Checking router: 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:21:15.209493 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Updating router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:21:15.234657 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Pushing event updated for resources: {'Port': ['ID=376cfe1f-23f1-4d2e-a93c-9a98a3effcca,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:15.247108 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.672s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:15.350285 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.354827 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.410200 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-5a2eef0d-8f31-470b-a824-fb65d683e711 None None] Provisioning for port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:15.416995 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 06123ab5-7778-4ce3-914e-df22dfe564c6, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=06123ab5-7778-4ce3-914e-df22dfe564c6,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:15.422873 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-5a2eef0d-8f31-470b-a824-fb65d683e711 None None] Provisioning complete for port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:15.423467 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-5a2eef0d-8f31-470b-a824-fb65d683e711 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.542077 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.562628 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-6e40df3c-37bc-438f-8b45-8996571cf523 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:15.647483 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-5a2eef0d-8f31-470b-a824-fb65d683e711 None None] Port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:21:15.688819 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-26e710bb-bdfe-46bf-aa2b-9d3a47b1379f req-2acd59c4-b4d6-4572-bca6-ef57d17c363e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0508397
May 28 14:21:15.724450 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=06123ab5-7778-4ce3-914e-df22dfe564c6,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:15.729537 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:15.819412 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.840358 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1635750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1808149'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.846046 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:15.854024 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.866695 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Transition to ACTIVE for port object 71ca7b78-f58e-42f2-b5dc-e78d77a8801c will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:15.885449 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=808409cc-59b4-4968-9d2c-3b30b9fe8243,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:15.904115 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:15.918589 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.926921 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] 10.222.0.59 "DELETE /v2.0/subnets/808409cc-59b4-4968-9d2c-3b30b9fe8243 HTTP/1.1" status: 204  len: 168 time: 1.2432487
May 28 14:21:15.929793 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55612) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:15.972003 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:15.977939 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:16.061416 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.070455 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Attempting to bind port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:21:16.070747 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Attempting to bind port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:21:16.071246 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Attempting to bind port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:16.080034 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe7ab1d9-9da1-41b4-ab83-f8e1422fb6d8 None None] Pushing event updated for resources: {'Port': ['ID=71ca7b78-f58e-42f2-b5dc-e78d77a8801c,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:16.083013 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 21, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:21:16.083415 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:16.083859 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.084299 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:21:16.085256 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Bound port: 71ca7b78-f58e-42f2-b5dc-e78d77a8801c, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:21:16.085397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.120950 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-fe7ab1d9-9da1-41b4-ab83-f8e1422fb6d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:16.174102 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] For port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:21:16.177351 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] For port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=71ca7b78-f58e-42f2-b5dc-e78d77a8801c,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:21:16.202767 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.216486 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba3228e80>,) {'filters': {'network_id': ['6983252e-f6f5-4128-ae62-287cd55d6fc1']}} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:16.228527 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba3228e80>, 'ae471620-a841-49d6-902b-c4e596986904') {'for_net_delete': True} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:16.228814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba3228e80>, 'ae471620-a841-49d6-902b-c4e596986904') {} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:16.240690 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1610771'] for segment, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.241869 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.257344 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.263775 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Releasing vlan 866 on physical network physnet1 to pool {{(pid=92695) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:21:16.264164 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1697792'] for segment, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]: Traceback (most recent call last):
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     timer()
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     cb(*args, **kw)
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     return func(*args, **kwargs)
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     self._notify()
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     self.callback(batched_events)
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     event.method(event)
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     return f(self, *a, **k)
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._get(url).json()
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self.request(url, 'GET', **kwargs)
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:21:16.278563 dv-cinder-791281-3-iscsi neutron-server[92695]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:21:16.315076 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.319734 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:16.399500 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe7ab1d9-9da1-41b4-ab83-f8e1422fb6d8 None None] Pushing event updated for resources: {'Port': ['ID=71ca7b78-f58e-42f2-b5dc-e78d77a8801c,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:16.403532 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-fe7ab1d9-9da1-41b4-ab83-f8e1422fb6d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:16.413872 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Routers {'8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:21:16.415460 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba270ed60>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:21:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:16.465729 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.503452 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.508672 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:16.544950 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.551275 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Pushing event deleted for resources: {'Network': ['ID=6983252e-f6f5-4128-ae62-287cd55d6fc1,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:16.555090 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] 10.222.0.59 "DELETE /v2.0/networks/6983252e-f6f5-4128-ae62-287cd55d6fc1 HTTP/1.1" status: 204  len: 168 time: 0.6241932
May 28 14:21:16.588471 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:16.599631 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.602609 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:16.612000 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:16.680435 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] Set router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:21:16.709308 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Allocated IP 172.20.0.1 (1145a91e-035d-40fe-813b-06d960bbe8ad/741b5b05-e852-43d4-a973-49d123a472b9/f9a61c41-ea07-4db2-b3e3-2d40ecdec76d) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:16.723759 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 06123ab5-7778-4ce3-914e-df22dfe564c6 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:16.769621 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Pushing event updated for resources: {'Port': ['ID=376cfe1f-23f1-4d2e-a93c-9a98a3effcca,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:16.775046 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:16.927211 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b1e53b6b-94b1-4531-8b59-c6b89efb20a6 req-8c723ab8-8e43-405e-931f-b6c73fd8cce6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0635726
May 28 14:21:16.976632 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 06123ab5-7778-4ce3-914e-df22dfe564c6 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:16.977008 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:17.029780 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Network 936c4847-d3d4-4250-b543-dc72dd308858 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:17.033316 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:17.051663 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:17.103005 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55650) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:17.211469 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba270ed60>, [{'id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155'}], 'enable_snat': True}, 'gw_port_id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:08Z', 'updated_at': '2021-05-28T14:21:11Z', 'revision_number': 3, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'gw_port': {'id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:7a:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:10Z', 'updated_at': '2021-05-28T14:21:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:17.226063 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3903d31-db20-40f4-bee1-1333a3cde1fc None None] The sync data for ids ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'] in dv-cinder-791281-3-iscsi is: [{'id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155'}], 'enable_snat': True}, 'gw_port_id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:08Z', 'updated_at': '2021-05-28T14:21:11Z', 'revision_number': 3, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'gw_port': {'id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:7a:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:10Z', 'updated_at': '2021-05-28T14:21:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:21:17.248853 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-f62d9fbd-42fe-401e-9b78-c91d5b60172d admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=b354d77c0fbf46b7b8ada7c2d13e728d&name=default HTTP/1.1" status: 200  len: 2975 time: 0.1426909
May 28 14:21:17.253638 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55660) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:17.346182 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e2be2574-f113-45c7-a2ea-caf4fce4662b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:17.361436 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Router 93611a0c-a5d3-438a-bf94-7453623f231d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:21:17.395451 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e2be2574-f113-45c7-a2ea-caf4fce4662b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:17.448458 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7c4c200a-e86e-4c53-a85e-147fdffc512b None None] Provisioning complete for port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:17.449057 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7c4c200a-e86e-4c53-a85e-147fdffc512b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:17.526400 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e2be2574-f113-45c7-a2ea-caf4fce4662b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:17.530564 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:17.531342 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:17.556345 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2be2574-f113-45c7-a2ea-caf4fce4662b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5bf6616-5547-4d40-a0ea-b25f3b9f3b92,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:17.559985 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e2be2574-f113-45c7-a2ea-caf4fce4662b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:17.563820 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-471501cf-0f28-4476-ba72-fde0290baa35 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:17.580180 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e2be2574-f113-45c7-a2ea-caf4fce4662b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:17.581364 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-e2be2574-f113-45c7-a2ea-caf4fce4662b admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b5bf6616-5547-4d40-a0ea-b25f3b9f3b92 HTTP/1.1" status: 204  len: 168 time: 0.3260069
May 28 14:21:17.600334 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7c4c200a-e86e-4c53-a85e-147fdffc512b None None] Port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:21:17.660367 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Network 1145a91e-035d-40fe-813b-06d960bbe8ad is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:17.697439 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:17.702519 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:21:17.713208 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:17.714149 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:17.721909 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Sync routers for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:21:17.739789 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:21:17.741788 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27625e0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:21:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:17.847283 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] 10.222.0.59 "PUT /v2.0/routers/93611a0c-a5d3-438a-bf94-7453623f231d/add_router_interface HTTP/1.1" status: 200  len: 503 time: 7.0558078
May 28 14:21:17.875853 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Pushing event updated for resources: {'Port': ['ID=f9a61c41-ea07-4db2-b3e3-2d40ecdec76d,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:17.879125 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:18.075272 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:18.111691 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.90', 61273) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:18.122453 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:21:18.356261 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8b82c029-9775-4324-a2d9-f6a42953ba48 req-a7486e25-3967-49f7-92f1-2514d597f0e5 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.1835659
May 28 14:21:18.744068 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98a24f30-a8a2-429d-909a-315071350179 req-249cc9b6-f95d-46fe-a7fe-d6740f9fe739 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:18.744068 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-249cc9b6-f95d-46fe-a7fe-d6740f9fe739 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.90 "GET /v2.0/networks?id=91ebc16a-e9fa-40de-8d8f-6fe4965dc314 HTTP/1.1" status: 200  len: 811 time: 0.4718966
May 28 14:21:18.748553 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:18.757113 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Request body: {'port': {'device_id': '2da8b01f-1c47-4118-bc09-bffde9f331b7', 'network_id': '91ebc16a-e9fa-40de-8d8f-6fe4965dc314', 'admin_state_up': True, 'tenant_id': '99ce685b86cb47abba407b2e49dcf373'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:18.757667 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 71ca7b78-f58e-42f2-b5dc-e78d77a8801c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:18.760157 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27625e0>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 2, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:18.763913 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Checking router: 93611a0c-a5d3-438a-bf94-7453623f231d for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:21:18.764365 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Updating router 93611a0c-a5d3-438a-bf94-7453623f231d port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:21:18.902626 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:18.909030 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:18.913907 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:18.917132 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:18.948681 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:18.957453 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:18.958083 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:18.997110 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:19.004916 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Usage tracker for resource:port and tenant:99ce685b86cb47abba407b2e49dcf373 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:19.012423 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:19.027110 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:19.101402 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Pushing event updated for resources: {'Port': ['ID=f9a61c41-ea07-4db2-b3e3-2d40ecdec76d,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:19.120807 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:19.143323 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Made reservation on behalf of 99ce685b86cb47abba407b2e49dcf373 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:19.147928 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:19.190028 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:19.210237 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55728) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:19.217666 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=71ca7b78-f58e-42f2-b5dc-e78d77a8801c,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:19.317878 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:19.323432 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:19.524172 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Network 1145a91e-035d-40fe-813b-06d960bbe8ad is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:19.526752 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:19.570298 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=71ca7b78-f58e-42f2-b5dc-e78d77a8801c,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:19.578389 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:19.700322 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55748) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:19.700656 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55754) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:19.708020 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Allocated IP 172.20.0.4 (91ebc16a-e9fa-40de-8d8f-6fe4965dc314/c8e92692-f94e-42ef-9b0b-7db259ad1468/6bfc4f29-c29d-4098-8314-02d1e6aa02a9) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:19.721388 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'security_group': {'name': 'tempest-securitygroup--953632368', 'description': 'tempest-description--1872318699'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:19.741299 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:19.745618 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-1a05f7bc-357c-45aa-bf2c-b136356b2b95 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=f57c5a8309a24ebbb0d81c7580b48fcf&name=default HTTP/1.1" status: 200  len: 2975 time: 0.5342391
May 28 14:21:19.748631 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55766) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:19.764723 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:19.775515 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:security_group and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:19.776444 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Transition to ACTIVE for port object 376cfe1f-23f1-4d2e-a93c-9a98a3effcca will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:19.780607 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:19.789328 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:19.869020 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:19.884840 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-cea999e3-6c81-41de-9c53-1e8f45c1110d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:19.945059 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:19.969951 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:21:19.985486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:19.990972 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Usage tracker for resource:security_group_rule and tenant:232ac97188ca40ecb9733bb13607c46b is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:19.995391 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:20.003874 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:20.072300 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-869fdf4f-5971-4e67-b0a8-d76f7688cad3 req-458597d8-0bad-4dcb-9724-d54c11b3535a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.2856836
May 28 14:21:20.141193 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.145208 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.152638 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fabec57-b683-4ddc-a1b3-2c8b5121b9d8 None None] Pushing event updated for resources: {'Port': ['ID=376cfe1f-23f1-4d2e-a93c-9a98a3effcca,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:20.159982 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-8fabec57-b683-4ddc-a1b3-2c8b5121b9d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:20.204477 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Attempting to bind port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:21:20.206056 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Attempting to bind port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:21:20.206430 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Attempting to bind port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca on network 936c4847-d3d4-4250-b543-dc72dd308858 {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:20.220723 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 21, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:21:20.221223 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Checking segment: {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:20.221629 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.222018 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Bound using segment: {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:21:20.222494 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Bound port: 376cfe1f-23f1-4d2e-a93c-9a98a3effcca, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:21:20.225936 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.264089 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.279538 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:20.292656 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:20.304188 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.374057 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-17d41699-2cfd-42f1-93cc-8c94b113318e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.414262 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-17d41699-2cfd-42f1-93cc-8c94b113318e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.417646 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] For port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:21:20.418279 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:security_group_rule and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:20.424443 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] For port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=376cfe1f-23f1-4d2e-a93c-9a98a3effcca,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:21:20.436852 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:20.467139 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:20.486674 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.498160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:20.530649 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=232ac97188ca40ecb9733bb13607c46b&name=default HTTP/1.1" status: 200  len: 2975 time: 0.8283153
May 28 14:21:20.538077 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55796) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:20.544237 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.545653 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9660cc28-b670-430d-aa9f-48da4196cba9,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:20.546028 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:21:20.564185 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:20.576944 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-f95ad228-ab7d-4b93-aa3b-785045d12f4e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:20.618455 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:21:20.619364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Network 91ebc16a-e9fa-40de-8d8f-6fe4965dc314 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:20.620102 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Sync routers for ids ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:21:20.625747 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Routers {'8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:21:20.628255 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba284c9d0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:21:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:20.629095 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] 10.222.0.59 "PUT /v2.0/routers/8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46/add_router_interface HTTP/1.1" status: 200  len: 503 time: 6.1591706
May 28 14:21:20.669356 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Pushing event updated for resources: {'Port': ['ID=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:20.700663 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-17d41699-2cfd-42f1-93cc-8c94b113318e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.721366 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:20.732716 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:20.740836 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:20.752745 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:21:20.753387 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27625e0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:21:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:20.777564 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 71ca7b78-f58e-42f2-b5dc-e78d77a8801c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:20.801339 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.830309 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:20.872203 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-17d41699-2cfd-42f1-93cc-8c94b113318e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.873555 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-17d41699-2cfd-42f1-93cc-8c94b113318e admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/f88049b5-87c9-4ca2-ae17-886ebfe9b4e6 HTTP/1.1" status: 204  len: 168 time: 1.1236751
May 28 14:21:20.906146 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d41699-2cfd-42f1-93cc-8c94b113318e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f88049b5-87c9-4ca2-ae17-886ebfe9b4e6,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:20.917846 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-17d41699-2cfd-42f1-93cc-8c94b113318e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:20.931131 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3cff3ff9-da95-49ee-8f9a-79eda5a6d51b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.933261 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:20.962760 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:21.010754 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3cff3ff9-da95-49ee-8f9a-79eda5a6d51b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:21.059579 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:21.064858 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1777 time: 1.3592970
May 28 14:21:21.068299 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55818) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:21.077144 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'security_group_rule': {'security_group_id': 'd2a399b1-c1b2-4892-8b44-28943526ac96', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:21.094103 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:21.104544 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d2a399b1-c1b2-4892-8b44-28943526ac96,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:21.109874 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:21.111496 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:security_group_rule and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:21.114088 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:21:21.117227 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:21.119853 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:21.120783 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:21.126239 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:21.224291 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Set router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:21:21.268688 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3cff3ff9-da95-49ee-8f9a-79eda5a6d51b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:21.272486 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3cff3ff9-da95-49ee-8f9a-79eda5a6d51b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:21.273695 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-3cff3ff9-da95-49ee-8f9a-79eda5a6d51b admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/9660cc28-b670-430d-aa9f-48da4196cba9 HTTP/1.1" status: 204  len: 168 time: 0.7346389
May 28 14:21:21.274837 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:21.293822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cff3ff9-da95-49ee-8f9a-79eda5a6d51b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9660cc28-b670-430d-aa9f-48da4196cba9,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:21.300308 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3cff3ff9-da95-49ee-8f9a-79eda5a6d51b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:21.315530 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.6459692
May 28 14:21:21.373731 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:21.374112 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:21.397611 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:21.587022 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fabec57-b683-4ddc-a1b3-2c8b5121b9d8 None None] Pushing event updated for resources: {'Port': ['ID=376cfe1f-23f1-4d2e-a93c-9a98a3effcca,revision_number=4']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:21.625541 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-8fabec57-b683-4ddc-a1b3-2c8b5121b9d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.049s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:21.660950 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:21.688003 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27625e0>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:20Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:21.705377 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68f5334-d232-4379-ad49-60de897cbc36 None None] The sync data for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi is: [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:20Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:21:21.714424 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb22487-7c95-435e-853b-a13905cb023a req-d17ac3d4-5501-496a-b1e3-876b1c5224df tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:21.733088 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-acb22487-7c95-435e-853b-a13905cb023a req-d17ac3d4-5501-496a-b1e3-876b1c5224df tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 931 time: 0.4239640
May 28 14:21:21.797372 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:21.825596 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:21.908720 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f75f97ea-423f-43d7-8345-1a6ad2263e3a,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:21.940222 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:21.943071 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-acb22487-7c95-435e-853b-a13905cb023a req-ee3120ee-99f4-42ba-9806-967ef1f6cef8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Synchronizing usage tracker for tenant:99ce685b86cb47abba407b2e49dcf373 on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:22.059411 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.063602 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.9909983
May 28 14:21:22.064275 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55856) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:22.071262 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'security_group_rule': {'security_group_id': 'd2a399b1-c1b2-4892-8b44-28943526ac96', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:22.081342 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:22.088691 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:security_group_rule and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:22.096083 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:22.109079 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:22.123227 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-acb22487-7c95-435e-853b-a13905cb023a req-ee3120ee-99f4-42ba-9806-967ef1f6cef8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Unset dirty status for tenant:99ce685b86cb47abba407b2e49dcf373 on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:22.125873 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-acb22487-7c95-435e-853b-a13905cb023a req-ee3120ee-99f4-42ba-9806-967ef1f6cef8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3870082
May 28 14:21:22.250282 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba284c9d0>, [{'id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155'}], 'enable_snat': True}, 'gw_port_id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:08Z', 'updated_at': '2021-05-28T14:21:17Z', 'revision_number': 4, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'gw_port': {'id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:7a:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:10Z', 'updated_at': '2021-05-28T14:21:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'f9a61c41-ea07-4db2-b3e3-2d40ecdec76d', 'name': '', 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'mac_address': 'fa:16:3e:a5:d2:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_interface', 'standard_attr_id': 87, 'fixed_ips': [{'subnet_id': '741b5b05-e852-43d4-a973-49d123a472b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:16Z', 'updated_at': '2021-05-28T14:21:18Z', 'revision_number': 2, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'subnets': [{'id': '741b5b05-e852-43d4-a973-49d123a472b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:22.254989 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Checking router: 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:21:22.255411 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Updating router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:21:22.276620 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.343457 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685200a0-3ae5-4924-95bf-10d987ed135a req-c337f2d5-3e8a-4823-b0c8-ba4f8a9c1bf1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:22.371055 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-c337f2d5-3e8a-4823-b0c8-ba4f8a9c1bf1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 819 time: 0.4751387
May 28 14:21:22.384003 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.388011 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-66048a4a-4086-488c-83db-7b86a8761022 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/quotas/71fbb9d6a3b643238579cd1698ca83e1 HTTP/1.1" status: 200  len: 375 time: 0.0157547
May 28 14:21:22.426629 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.503104 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55872) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:22.545474 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.571458 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-8e612cdb-c65e-4c0a-85cb-480fd2f558a2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1823425
May 28 14:21:22.598371 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:22.604670 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.614816 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Usage tracker for resource:security_group_rule and tenant:705e1ffbdd4c419eb178bfaa51aacd99 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:22.644901 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:22.650340 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-26ab556f-7fcd-4c45-a582-72e4bd619dd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:22.663420 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:22.675488 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=31624816-6228-4141-b90c-ac93e4796bbc,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:22.683313 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:22.714298 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.716636 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.6503258
May 28 14:21:22.723134 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 55880) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:22.731117 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'floatingip': {'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:22.753651 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 376cfe1f-23f1-4d2e-a93c-9a98a3effcca up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:22.760446 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:22.780794 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:floatingip and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:22.790567 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:22.807604 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:22.903225 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.924261 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-ee511dc3-d888-4da9-92a7-5bf9e6ec9d51 service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92695) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:21:22.925663 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-ee511dc3-d888-4da9-92a7-5bf9e6ec9d51 service neutron] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0933809
May 28 14:21:22.962129 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.977406 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:22.993272 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:23.084316 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=705e1ffbdd4c419eb178bfaa51aacd99&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5776758
May 28 14:21:23.084316 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2ce0b21-958f-4b51-869d-284675aab046,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:23.085908 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 55894) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:23.106078 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:23.243614 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-712c1d31-e1fd-4ec4-80b2-c4cf2d0d8064 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:23.246674 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-f4c00ee0-aa82-4e96-93d7-d18bd1b0ddc0 service neutron] 10.222.0.59 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3134890
May 28 14:21:23.263265 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:23.294274 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:23.294831 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:23.301405 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-712c1d31-e1fd-4ec4-80b2-c4cf2d0d8064 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:23.388831 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:23.457152 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Transition to ACTIVE for port object f9a61c41-ea07-4db2-b3e3-2d40ecdec76d will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:23.506513 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-00e482a2-8f7c-4ba9-96fe-255b07d29394 service neutron] 10.222.0.59 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2520747
May 28 14:21:23.515003 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:23.605262 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:23.639960 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-fe7ab1d9-9da1-41b4-ab83-f8e1422fb6d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:23.645607 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4df0608-08cd-49a6-9999-66ac3176d169 req-8faad097-8ff3-4ca0-9162-0435d12f0928 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:23.647932 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a4df0608-08cd-49a6-9999-66ac3176d169 req-8faad097-8ff3-4ca0-9162-0435d12f0928 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 931 time: 0.2735379
May 28 14:21:23.672551 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-712c1d31-e1fd-4ec4-80b2-c4cf2d0d8064 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:23.722612 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:23.761974 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-712c1d31-e1fd-4ec4-80b2-c4cf2d0d8064 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2ce0b21-958f-4b51-869d-284675aab046,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:23.775946 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81068cd9-b53c-4fb4-b411-9a905602769d None None] Pushing event updated for resources: {'Port': ['ID=f9a61c41-ea07-4db2-b3e3-2d40ecdec76d,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:23.776880 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-712c1d31-e1fd-4ec4-80b2-c4cf2d0d8064 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:23.778040 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-712c1d31-e1fd-4ec4-80b2-c4cf2d0d8064 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/e2ce0b21-958f-4b51-869d-284675aab046 HTTP/1.1" status: 204  len: 168 time: 0.6789377
May 28 14:21:23.796825 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-712c1d31-e1fd-4ec4-80b2-c4cf2d0d8064 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:23.799874 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-81068cd9-b53c-4fb4-b411-9a905602769d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:23.838973 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a4df0608-08cd-49a6-9999-66ac3176d169 req-04f75fb9-2c20-48d8-bf50-aff862e4d4af tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1725290
May 28 14:21:23.926590 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Allocated IP 172.27.3.190 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/ddf95fa8-cae5-47b8-8630-d2ca2c5d1d3f) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:24.064449 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:24.214437 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=376cfe1f-23f1-4d2e-a93c-9a98a3effcca,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:24.216884 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Attempting to bind port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:21:24.217465 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Attempting to bind port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:21:24.217821 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Attempting to bind port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d on network 1145a91e-035d-40fe-813b-06d960bbe8ad {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:24.253402 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 21, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:21:24.260310 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Checking segment: {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:24.261122 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:24.262315 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Bound using segment: {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:21:24.263269 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Bound port: f9a61c41-ea07-4db2-b3e3-2d40ecdec76d, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:21:24.263763 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:24.264769 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1241a4fc-ce69-4c4d-92ca-296bc2028393 req-8d0766a6-2b02-4ace-b66c-248066d0edce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 210 time: 0.1226292
May 28 14:21:24.282793 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:24.291030 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-1b7664b5-6164-4593-8e00-082bbe46eb86 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:24.358111 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:24.448464 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=376cfe1f-23f1-4d2e-a93c-9a98a3effcca,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:24.454120 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:24.460214 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] For port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:21:24.463514 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] For port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f9a61c41-ea07-4db2-b3e3-2d40ecdec76d,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:21:24.470320 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:24.476298 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-6954f4ae-cfa7-459e-b1fe-f310d0ef1f38 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:24.550108 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:24.558010 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-1b7664b5-6164-4593-8e00-082bbe46eb86 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:24.573253 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:24.576859 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:24.579959 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:24.753085 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'Port': ['ID=ddf95fa8-cae5-47b8-8630-d2ca2c5d1d3f,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:24.766901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:24.773954 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 376cfe1f-23f1-4d2e-a93c-9a98a3effcca up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:24.857860 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:24.861901 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Routers {'8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:21:24.864132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba284c9d0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:21:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:24.950368 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-3a78e942-4c19-4baa-8c05-1786a7d2cd5c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:24.951211 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-3a78e942-4c19-4baa-8c05-1786a7d2cd5c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Synchronizing usage tracker for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:network {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:25.041712 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81068cd9-b53c-4fb4-b411-9a905602769d None None] Pushing event updated for resources: {'Port': ['ID=f9a61c41-ea07-4db2-b3e3-2d40ecdec76d,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:25.049712 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-81068cd9-b53c-4fb4-b411-9a905602769d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.492s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:25.089037 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-3a78e942-4c19-4baa-8c05-1786a7d2cd5c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Unset dirty status for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:network {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:25.090580 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-3a78e942-4c19-4baa-8c05-1786a7d2cd5c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 819 time: 0.4737136
May 28 14:21:25.117265 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-1d31a0d6-2016-44c2-8e57-8b07be967ad8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/quotas/71fbb9d6a3b643238579cd1698ca83e1 HTTP/1.1" status: 200  len: 375 time: 0.0194912
May 28 14:21:25.215585 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:25.227116 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-cc8ae791-1c90-4c6a-b526-5ef5b0d814a9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Synchronizing usage tracker for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:25.242789 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] Set router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:21:25.315340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a req-b3627ac5-909f-4132-a1ed-d5603dce44b4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:25.316963 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a req-b3627ac5-909f-4132-a1ed-d5603dce44b4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Synchronizing usage tracker for tenant:99ce685b86cb47abba407b2e49dcf373 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:25.328901 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:25.328901 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:25.371591 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-cc8ae791-1c90-4c6a-b526-5ef5b0d814a9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Unset dirty status for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:25.371591 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-cc8ae791-1c90-4c6a-b526-5ef5b0d814a9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&fields=id HTTP/1.1" status: 200  len: 255 time: 0.2530029
May 28 14:21:25.526097 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a req-b3627ac5-909f-4132-a1ed-d5603dce44b4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Unset dirty status for tenant:99ce685b86cb47abba407b2e49dcf373 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:25.529465 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a req-b3627ac5-909f-4132-a1ed-d5603dce44b4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 931 time: 0.4091253
May 28 14:21:25.663642 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ac5cead2-7070-4dd9-8ac1-01bc9ff3238a req-e2b6fc42-b3ad-4faf-82d9-2a7b39365605 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1191077
May 28 14:21:25.665950 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:25.709886 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:25.721247 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc3ba1b9-109a-4c4f-8dfe-e53122de1a12 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:25.723968 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-2d8d3a16-969c-47a9-ba8d-65e4508ec2a2 service neutron] 10.222.0.59 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3394370
May 28 14:21:25.998347 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'Port': ['ID=ddf95fa8-cae5-47b8-8630-d2ca2c5d1d3f,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:26.002309 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:26.023160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:26.040478 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-b7c6e0aa-efef-4d45-90ee-d80ededdc650 service neutron] 10.222.0.59 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3086908
May 28 14:21:26.179318 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba284c9d0>, [{'id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155'}], 'enable_snat': True}, 'gw_port_id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:08Z', 'updated_at': '2021-05-28T14:21:17Z', 'revision_number': 4, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'gw_port': {'id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:7a:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:10Z', 'updated_at': '2021-05-28T14:21:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'f9a61c41-ea07-4db2-b3e3-2d40ecdec76d', 'name': '', 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'mac_address': 'fa:16:3e:a5:d2:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_interface', 'standard_attr_id': 87, 'fixed_ips': [{'subnet_id': '741b5b05-e852-43d4-a973-49d123a472b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:16Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 4, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'subnets': [{'id': '741b5b05-e852-43d4-a973-49d123a472b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:21:26.185692 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1c0b7bd-710d-48bd-93f4-6da9b12b5ff9 None None] The sync data for ids ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'] in dv-cinder-791281-3-iscsi is: [{'id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155'}], 'enable_snat': True}, 'gw_port_id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:08Z', 'updated_at': '2021-05-28T14:21:17Z', 'revision_number': 4, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'gw_port': {'id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:7a:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:10Z', 'updated_at': '2021-05-28T14:21:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'f9a61c41-ea07-4db2-b3e3-2d40ecdec76d', 'name': '', 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'mac_address': 'fa:16:3e:a5:d2:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_interface', 'standard_attr_id': 87, 'fixed_ips': [{'subnet_id': '741b5b05-e852-43d4-a973-49d123a472b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:16Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 4, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'subnets': [{'id': '741b5b05-e852-43d4-a973-49d123a472b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:21:26.325658 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:26.329657 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 3.6032996
May 28 14:21:26.652793 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5deab5af-e0e5-40d2-b6a8-536ac6e51374 req-4a79d75a-9a3b-464f-8810-fd57f6e0f8c3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.1327696
May 28 14:21:26.865898 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f9a61c41-ea07-4db2-b3e3-2d40ecdec76d up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:27.001884 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-084e7aa0-bf85-4670-91b4-de1918a76afe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Synchronizing usage tracker for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:27.133464 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c921aac6-2102-4a10-b6ff-0ced79ebd31e req-6cee3cf8-5b46-4997-b7e6-1595d2a9a00a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:27.135153 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c921aac6-2102-4a10-b6ff-0ced79ebd31e req-6cee3cf8-5b46-4997-b7e6-1595d2a9a00a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 931 time: 0.1355953
May 28 14:21:27.137837 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-084e7aa0-bf85-4670-91b4-de1918a76afe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Unset dirty status for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:27.140659 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-084e7aa0-bf85-4670-91b4-de1918a76afe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-securitygroup--953632368&fields=id&tenant_id=3bbdb80ac64d4db395d276876322e7b0 HTTP/1.1" status: 200  len: 267 time: 0.2431235
May 28 14:21:27.214247 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:27.222978 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:27.223451 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:27.261180 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c921aac6-2102-4a10-b6ff-0ced79ebd31e req-9a8b71a6-005d-4c67-b5ab-cec2142f7969 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1014190
May 28 14:21:27.312341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-5646138e-1c90-4282-aa00-fd515f51f476 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92695) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:21:27.313291 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-5646138e-1c90-4282-aa00-fd515f51f476 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.90 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0056531
May 28 14:21:27.547220 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-d6d896e3-2ee0-45fa-82bb-e93b68672028 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:27.553920 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-d6d896e3-2ee0-45fa-82bb-e93b68672028 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 817 time: 0.3929548
May 28 14:21:27.581305 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-e7553c0d-e2a9-4d16-9ad9-3487ecc6ef66 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/quotas/3bbdb80ac64d4db395d276876322e7b0 HTTP/1.1" status: 200  len: 375 time: 0.0264487
May 28 14:21:27.720918 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56084) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:27.753629 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:27.837364 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:27.881300 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f9a61c41-ea07-4db2-b3e3-2d40ecdec76d,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:27.911372 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2dc45ad1-1346-46e2-a318-907b503f2e5b req-7f65b74a-fa81-491a-ad87-787d753914f7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.1214845
May 28 14:21:27.931734 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-69bfcae8-fc66-49cb-a5cf-4378fc0cf0ec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Synchronizing usage tracker for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:27.950178 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:27.954098 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:28.023027 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-69bfcae8-fc66-49cb-a5cf-4378fc0cf0ec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Unset dirty status for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:28.035410 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-69bfcae8-fc66-49cb-a5cf-4378fc0cf0ec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&fields=id HTTP/1.1" status: 200  len: 348 time: 0.4447594
May 28 14:21:28.123243 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Request body: {'port': {'device_id': '2da8b01f-1c47-4118-bc09-bffde9f331b7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:28.144534 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=f9a61c41-ea07-4db2-b3e3-2d40ecdec76d,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:28.156518 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:28.190998 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:28.218204 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:28.222992 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Usage tracker for resource:security_group_rule and tenant:7bc0d1449b2645ddb3915a3881fe878d is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:28.227159 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:28.234269 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:28.402598 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6d6f1f3f-4bb1-4180-905a-0cc7f7707d02 service neutron] 10.222.0.59 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3249698
May 28 14:21:28.424244 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:28.737585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f9a61c41-ea07-4db2-b3e3-2d40ecdec76d up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:28.738183 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:28.837271 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:28.851490 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4e2f3a8b-7ed7-4254-a346-c9d7f686c6f0 service neutron] 10.222.0.59 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4415362
May 28 14:21:28.880340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:28.954350 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:28.954958 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:29.033182 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f req-5b05acbf-be0e-496e-9755-4f1d18db06d0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:29.034792 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f req-5b05acbf-be0e-496e-9755-4f1d18db06d0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 931 time: 0.5639322
May 28 14:21:29.043445 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=7bc0d1449b2645ddb3915a3881fe878d&name=default HTTP/1.1" status: 200  len: 2979 time: 1.3187883
May 28 14:21:29.043445 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=749a1cbd-b42a-4c12-ac5c-cc694fa04024,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:29.044544 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56114) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:29.057169 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:29.190165 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bcd7d7b3-1ca0-465d-8de2-b5af3b08f935 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:29.230059 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bcd7d7b3-1ca0-465d-8de2-b5af3b08f935 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:29.251080 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1326c7f2-1f1d-42f9-bda1-5a3bd5ef085f req-31625f31-6599-4d9f-a77b-a64134646061 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1926305
May 28 14:21:29.411412 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bcd7d7b3-1ca0-465d-8de2-b5af3b08f935 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:29.418497 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:29.449772 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcd7d7b3-1ca0-465d-8de2-b5af3b08f935 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=749a1cbd-b42a-4c12-ac5c-cc694fa04024,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:29.469808 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-bcd7d7b3-1ca0-465d-8de2-b5af3b08f935 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:29.576665 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bcd7d7b3-1ca0-465d-8de2-b5af3b08f935 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:29.578782 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-bcd7d7b3-1ca0-465d-8de2-b5af3b08f935 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/749a1cbd-b42a-4c12-ac5c-cc694fa04024 HTTP/1.1" status: 204  len: 168 time: 0.5341542
May 28 14:21:29.589603 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-61c3eda6-ee11-487f-bd85-b8ab03640125 req-22f3fe12-a6dd-40b3-b181-ab6a8b0dbf6f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.1185164
May 28 14:21:29.642252 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8df1869f-8e32-4c1f-b90b-986853038519 req-80a01030-4eb8-42be-bf8c-09fd1b78df20 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.1920955
May 28 14:21:29.716048 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:21:29.852891 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:29.852891 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Transition to ACTIVE for port object 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:30.486493 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c953f78-aaf8-4a26-a369-8d561a846393 req-40a6e176-88ef-4036-b2df-19bfb3041d53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:30.488012 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6c953f78-aaf8-4a26-a369-8d561a846393 req-40a6e176-88ef-4036-b2df-19bfb3041d53 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 931 time: 0.0894351
May 28 14:21:30.537431 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6c953f78-aaf8-4a26-a369-8d561a846393 req-7dc7ffb7-8b30-4969-94af-59bd67719a0f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408344
May 28 14:21:30.757377 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8195ee12-f383-4349-92b2-e9a48f9b77f1 req-dbfaae4a-6111-4a01-b4c8-8d4399c10b0d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0500658
May 28 14:21:30.765596 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d49fdd64-4573-427f-90fa-55d09701299c req-317d8a2b-14ba-4664-95a9-4eaace8a3b14 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0696213
May 28 14:21:30.846414 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-50487b43-0656-4c60-94e1-fd7e63b70afa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:30.850587 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:30.862518 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4db2727-420a-4460-a7ea-182292059b70 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:31.187757 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Pushing event updated for resources: {'Port': ['ID=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:31.199909 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.337s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:31.269135 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Attempting to bind port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:21:31.269322 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Attempting to bind port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': '91ebc16a-e9fa-40de-8d8f-6fe4965dc314'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:21:31.269889 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Attempting to bind port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 on network 91ebc16a-e9fa-40de-8d8f-6fe4965dc314 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:31.282653 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 on network 91ebc16a-e9fa-40de-8d8f-6fe4965dc314 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:21:31.286322 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Attempting to bind port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 on network 91ebc16a-e9fa-40de-8d8f-6fe4965dc314 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:31.289581 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 21, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:21:31.290299 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Checking segment: {'id': '5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': '91ebc16a-e9fa-40de-8d8f-6fe4965dc314'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:31.291025 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Bound using segment: {'id': '5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': '91ebc16a-e9fa-40de-8d8f-6fe4965dc314'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:21:31.291964 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Bound port: 6bfc4f29-c29d-4098-8314-02d1e6aa02a9, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': '91ebc16a-e9fa-40de-8d8f-6fe4965dc314'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:21:31.292703 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:31.451910 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] For port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:21:31.456487 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] For port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,segment=NetworkSegment(5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811),segment_id=5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:21:31.526956 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:31.559547 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:31.701615 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Pushing event updated for resources: {'Port': ['ID=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:31.705799 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:31.707582 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:31.708433 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:31.711195 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] 10.222.0.90 "PUT /v2.0/ports/6bfc4f29-c29d-4098-8314-02d1e6aa02a9 HTTP/1.1" status: 200  len: 1093 time: 3.7986889
May 28 14:21:31.716515 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2da8b01f-1c47-4118-bc09-bffde9f331b7', 'tag': '6bfc4f29-c29d-4098-8314-02d1e6aa02a9'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:21:31.995064 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-519ddd2d-1aee-44ef-a01f-4074c7e0611a req-79a0d84c-20fb-4728-85ae-782f960189b9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0691838
May 28 14:21:32.054395 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ea5a66-57e2-4454-8267-cd6ba006ed05 req-021feeaf-e321-4a53-9937-dfc82bbc3dce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:32.064370 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-34ea5a66-57e2-4454-8267-cd6ba006ed05 req-021feeaf-e321-4a53-9937-dfc82bbc3dce tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.2979784
May 28 14:21:32.165389 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9dce51e8-d2bb-4b74-85f5-e8b8912ed2c3 req-05d35613-dc73-4297-854a-856b4ad9a0e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0549002
May 28 14:21:32.182952 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-34ea5a66-57e2-4454-8267-cd6ba006ed05 req-df7d997e-a137-4896-8c0e-121254e66365 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1064632
May 28 14:21:32.412484 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2da8b01f-1c47-4118-bc09-bffde9f331b7', 'tag': '6bfc4f29-c29d-4098-8314-02d1e6aa02a9', 'status': 'completed', 'code': 200}
May 28 14:21:32.571444 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:32.623178 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-66f559e7-9a5c-4fd8-8f2e-d61d4969e4f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:33.164715 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-be58be62-55d5-4250-9b83-8577483a84fa req-3124d752-a7e0-4b06-885a-c06693502987 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0525110
May 28 14:21:33.417786 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a34669d5-8341-4831-835b-6017a978fc94 req-547c3784-18b6-4499-bb29-a66998d1411e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0761950
May 28 14:21:33.444584 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d457b304-00f8-42cc-8cfd-63d6dff1b656 req-4c2897ef-2b01-445c-9a53-1ef79bc8fc96 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:33.446570 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d457b304-00f8-42cc-8cfd-63d6dff1b656 req-4c2897ef-2b01-445c-9a53-1ef79bc8fc96 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.1103594
May 28 14:21:33.497422 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d457b304-00f8-42cc-8cfd-63d6dff1b656 req-2f8410b3-ed7d-4218-9637-e701e5d2f672 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456541
May 28 14:21:33.702881 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:34.342206 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56292) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:34.374404 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0662f41e-227e-4bfa-9fa5-aa8c8796b7d3 req-aaf96572-e747-4ade-ae46-185eec69fc2f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0515878
May 28 14:21:34.515465 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56304) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:34.715962 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e76818be-73e0-4e42-bc08-06e46297095f req-67260701-011c-40e6-919c-a7eee5e708cd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0827382
May 28 14:21:34.717562 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:34.750190 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:34.768656 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:34.774932 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Usage tracker for resource:security_group_rule and tenant:d1fab99b773041cc8f22cc69cb47ada7 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:34.778437 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:34.781197 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:34.785201 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Usage tracker for resource:security_group_rule and tenant:9831f1b0b9bc4ea1abf43482e9a92daa is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:34.785606 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:34.790203 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:34.799497 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:34.841561 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e928b-f243-4ab6-8b02-2388eb4b6979 req-103bc535-c450-449b-a1a8-89ae03782eeb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:34.843082 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-715e928b-f243-4ab6-8b02-2388eb4b6979 req-103bc535-c450-449b-a1a8-89ae03782eeb tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.1738656
May 28 14:21:34.928574 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-715e928b-f243-4ab6-8b02-2388eb4b6979 req-d033d334-51af-4399-8619-82e9b4a59f1d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0794988
May 28 14:21:34.956933 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:34.989401 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.057821 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.065357 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:35.106526 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=d1fab99b773041cc8f22cc69cb47ada7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7632508
May 28 14:21:35.107565 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da378b46-167e-4e30-b38d-3d33c0c3cd30,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:35.110856 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:35.120055 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56316) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:35.145033 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.170860 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9174d04e-a722-4717-87dc-7f136b3b7cbd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:35.237969 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4d1fbb2a-a955-47f2-afb0-e0e356685ce8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.242657 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=9831f1b0b9bc4ea1abf43482e9a92daa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7260251
May 28 14:21:35.244906 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ddfcdfd-ead3-48f8-98cf-f6e1dfc9c3f3,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:35.246184 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56324) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:35.254703 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:35.276999 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4d1fbb2a-a955-47f2-afb0-e0e356685ce8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.326124 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cb404381-8280-49d3-b87c-7da015b5b837 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.355384 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cb404381-8280-49d3-b87c-7da015b5b837 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.370380 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.440572 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4d1fbb2a-a955-47f2-afb0-e0e356685ce8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.452619 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:35.471061 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d1fbb2a-a955-47f2-afb0-e0e356685ce8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da378b46-167e-4e30-b38d-3d33c0c3cd30,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:35.483610 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4d1fbb2a-a955-47f2-afb0-e0e356685ce8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:35.485974 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cb404381-8280-49d3-b87c-7da015b5b837 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.486096 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4d1fbb2a-a955-47f2-afb0-e0e356685ce8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.487518 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-4d1fbb2a-a955-47f2-afb0-e0e356685ce8 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/da378b46-167e-4e30-b38d-3d33c0c3cd30 HTTP/1.1" status: 204  len: 168 time: 0.3664615
May 28 14:21:35.494287 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:35.517215 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb404381-8280-49d3-b87c-7da015b5b837 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ddfcdfd-ead3-48f8-98cf-f6e1dfc9c3f3,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:35.540150 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cb404381-8280-49d3-b87c-7da015b5b837 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:35.596144 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fabe538b-c576-4123-8fcc-d8f14a77ac4a req-a385cb5a-a251-46fe-a515-ee0400f29068 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0906987
May 28 14:21:35.600766 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cb404381-8280-49d3-b87c-7da015b5b837 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:35.601797 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-cb404381-8280-49d3-b87c-7da015b5b837 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/8ddfcdfd-ead3-48f8-98cf-f6e1dfc9c3f3 HTTP/1.1" status: 204  len: 168 time: 0.3544781
May 28 14:21:35.893695 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b5aa975b-fbe3-4539-8eef-186185aa76e5 req-7ad424ce-bec0-44ee-b4cf-8334ed7f69c4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0433431
May 28 14:21:36.112479 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d2c2ea-3961-480f-85af-9353829628b8 req-0d6af7fa-0c38-42ff-8316-546a96ddfd15 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:36.114328 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c0d2c2ea-3961-480f-85af-9353829628b8 req-0d6af7fa-0c38-42ff-8316-546a96ddfd15 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.0835989
May 28 14:21:36.159681 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c0d2c2ea-3961-480f-85af-9353829628b8 req-23d4a4a0-5dda-47fa-8248-478ad7043d86 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392370
May 28 14:21:36.328950 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56356) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:36.350464 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.365107 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:36.369134 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Usage tracker for resource:security_group_rule and tenant:e095ecbfe7774a50b0913d536b3afcb3 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:36.372033 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:36.377636 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:36.418362 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56362) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:36.435829 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.451732 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:36.455208 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Usage tracker for resource:security_group_rule and tenant:d2914f07476543bdbb878f46dd9d56f9 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:36.458239 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:36.465001 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:36.466955 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.531362 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.540770 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-af551bfc-10f1-44ce-be76-e33c36dce266 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:36.580740 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=e095ecbfe7774a50b0913d536b3afcb3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2507224
May 28 14:21:36.581643 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df088b40-5777-4b66-beee-1f33141d8fd2,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:36.584111 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56370) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:36.585472 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:36.640329 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.671224 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9200226a-6d72-48d6-b1ec-0306db67e4c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.698100 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9200226a-6d72-48d6-b1ec-0306db67e4c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.742601 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.743090 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ba50d85c-3915-41ee-98f3-9230563dfabc req-a421bbcd-681d-4f26-afd4-a43d60548bc0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0422845
May 28 14:21:36.752828 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e2be2574-f113-45c7-a2ea-caf4fce4662b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:36.791381 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=d2914f07476543bdbb878f46dd9d56f9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3718188
May 28 14:21:36.793224 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73837255-d36e-4240-a4e0-858247833057,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:36.794175 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56376) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:36.796274 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:36.822826 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9200226a-6d72-48d6-b1ec-0306db67e4c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.835629 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:36.849973 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9200226a-6d72-48d6-b1ec-0306db67e4c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df088b40-5777-4b66-beee-1f33141d8fd2,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:36.853157 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9200226a-6d72-48d6-b1ec-0306db67e4c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:36.857562 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9200226a-6d72-48d6-b1ec-0306db67e4c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.858660 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-9200226a-6d72-48d6-b1ec-0306db67e4c3 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/df088b40-5777-4b66-beee-1f33141d8fd2 HTTP/1.1" status: 204  len: 168 time: 0.2735791
May 28 14:21:36.861006 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0ebb94ac-b0e0-48a0-97fa-455156fead8b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:36.888992 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0ebb94ac-b0e0-48a0-97fa-455156fead8b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:37.017382 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0ebb94ac-b0e0-48a0-97fa-455156fead8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:37.023128 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:37.035295 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebb94ac-b0e0-48a0-97fa-455156fead8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73837255-d36e-4240-a4e0-858247833057,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:37.038785 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0ebb94ac-b0e0-48a0-97fa-455156fead8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:37.058661 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2e574500-daeb-4001-9c59-b03b14455fcc req-6260179e-3c83-4295-bb5d-0e44588fa792 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0513928
May 28 14:21:37.060830 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0ebb94ac-b0e0-48a0-97fa-455156fead8b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:37.061967 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-0ebb94ac-b0e0-48a0-97fa-455156fead8b admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/73837255-d36e-4240-a4e0-858247833057 HTTP/1.1" status: 204  len: 168 time: 0.2667451
May 28 14:21:37.344722 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2573734-bfe1-498e-ac65-3a2539adc71d req-1d7ce6cf-3c75-4030-85ce-b77b3bb2939c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:37.346131 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e2573734-bfe1-498e-ac65-3a2539adc71d req-1d7ce6cf-3c75-4030-85ce-b77b3bb2939c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.0815463
May 28 14:21:37.396196 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e2573734-bfe1-498e-ac65-3a2539adc71d req-97c5a883-00c9-4719-8f3d-12322afbd36e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436676
May 28 14:21:37.901607 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4e0a3d84-8b5b-4c1e-a906-802bfa779767 req-a6082601-2323-467c-83b2-8d4d5ae95382 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0493555
May 28 14:21:38.230637 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5a6947c3-b603-4d3b-8e45-b0ef634b7fe0 req-b71deb31-6d38-4127-adf0-bbb5e01e52cf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0429194
May 28 14:21:38.594930 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132d824b-cd9b-4990-8a9f-6f556f365d7c req-875eef44-1444-4279-9ae2-de7e5b5bfeb6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:38.596501 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-132d824b-cd9b-4990-8a9f-6f556f365d7c req-875eef44-1444-4279-9ae2-de7e5b5bfeb6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.0812733
May 28 14:21:38.650725 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-132d824b-cd9b-4990-8a9f-6f556f365d7c req-fe19a458-17fb-4cdc-92a0-7b766b15f761 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471897
May 28 14:21:39.056498 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7d64751e-461d-43a4-854b-796f54886d40 req-d0c4b664-b64b-49db-aefa-cde767a4102b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0449204
May 28 14:21:39.392308 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9a96fbb0-cd28-4230-b5a4-c4666b17ad52 req-791dba78-7fac-4a3d-b6bc-476b3e6c3260 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0475433
May 28 14:21:39.844764 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf3e190-8e66-44bc-baea-86ea24294f32 req-063f2830-f59f-499a-96f4-e42db5797931 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:39.846582 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cbf3e190-8e66-44bc-baea-86ea24294f32 req-063f2830-f59f-499a-96f4-e42db5797931 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.0963352
May 28 14:21:39.905031 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cbf3e190-8e66-44bc-baea-86ea24294f32 req-36ce1f37-a66e-4511-abdc-88aaa951fcb7 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0518661
May 28 14:21:39.996990 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56516) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:40.122987 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:40.138063 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:40.147088 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Usage tracker for resource:security_group_rule and tenant:89be35c2633640db8791a2f8954bd547 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:40.147088 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:40.151737 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:40.212291 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f58ae789-3794-4505-bf86-c9bbafc0d434 req-72d08830-e4ee-47d5-9cba-a514d8b9591f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0451586
May 28 14:21:40.252528 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:40.354317 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:40.361994 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4af0cebd-bff4-48fc-bd74-8a732d981368 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:40.402346 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=89be35c2633640db8791a2f8954bd547&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4043496
May 28 14:21:40.403285 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=541b921b-af5f-4934-a397-8628a0f95654,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:40.405175 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56526) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:40.406303 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:40.466073 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9a28892f-1c0c-4a41-b9d7-f3b56fb8cbb1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:40.492940 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9a28892f-1c0c-4a41-b9d7-f3b56fb8cbb1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:40.606105 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-edea750b-96e3-4e7f-a0cb-3be82a52b457 req-f596b8b9-4117-4d9d-9dbf-94e2e02fe710 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0979552
May 28 14:21:40.691929 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9a28892f-1c0c-4a41-b9d7-f3b56fb8cbb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:40.697697 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:40.710378 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a28892f-1c0c-4a41-b9d7-f3b56fb8cbb1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=541b921b-af5f-4934-a397-8628a0f95654,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:40.712912 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9a28892f-1c0c-4a41-b9d7-f3b56fb8cbb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:40.714050 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9a28892f-1c0c-4a41-b9d7-f3b56fb8cbb1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:40.715137 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-9a28892f-1c0c-4a41-b9d7-f3b56fb8cbb1 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/541b921b-af5f-4934-a397-8628a0f95654 HTTP/1.1" status: 204  len: 168 time: 0.3084402
May 28 14:21:41.090017 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51eaf9e4-3be9-495f-8661-2e78035a5f12 req-1828562e-2741-474f-a4e4-e844fe657939 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:41.091470 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51eaf9e4-3be9-495f-8661-2e78035a5f12 req-1828562e-2741-474f-a4e4-e844fe657939 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.0791440
May 28 14:21:41.136605 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51eaf9e4-3be9-495f-8661-2e78035a5f12 req-9938f3d7-01b1-4c24-85a0-7783024be1b9 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390921
May 28 14:21:41.363965 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-50632f37-d865-49ec-825b-bd729cde10f3 req-cb443bf9-d700-4238-8f37-d0d5e2cf9fb0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0429225
May 28 14:21:41.455957 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56552) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:41.473246 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:41.484730 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-6fdde817-734f-4b27-b367-d4901a9b7b21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:41.486777 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-6fdde817-734f-4b27-b367-d4901a9b7b21 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=99ce685b86cb47abba407b2e49dcf373&device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 1096 time: 0.0754697
May 28 14:21:41.489265 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:41.493630 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Usage tracker for resource:security_group_rule and tenant:4f9421109a8e4e7b820e6cb7384b041d is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:41.496392 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:41.502150 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:41.586448 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:41.684179 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:41.700127 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:41.713656 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-ecae5e4c-799f-4a3d-8042-db3267a1b6ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:41.715991 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-ecae5e4c-799f-4a3d-8042-db3267a1b6ca service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=99ce685b86cb47abba407b2e49dcf373&shared=False HTTP/1.1" status: 200  len: 912 time: 0.2118871
May 28 14:21:41.760392 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=177ba268-e842-49f3-9745-45b2a571e0f8,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:41.767146 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=4f9421109a8e4e7b820e6cb7384b041d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3077211
May 28 14:21:41.767146 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:41.767409 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56560) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:41.834639 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8516d70e-2728-4dad-aea9-112ee36f9f93 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:41.844335 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-be0c8a5c-ee07-49ec-811f-8bde48f1674c req-872617f6-a3f1-4575-b298-491f12c61886 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0943201
May 28 14:21:41.873068 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8516d70e-2728-4dad-aea9-112ee36f9f93 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:41.900408 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-3238fd03-bf7b-4bad-bb38-d75476f8278e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:41.901780 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5286360-ad4f-4497-8889-746fddaa0c06 req-3238fd03-bf7b-4bad-bb38-d75476f8278e service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1733012
May 28 14:21:42.027817 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98a24f30-a8a2-429d-909a-315071350179 req-876f1719-7730-464c-847b-18db426bc277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:42.029273 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-876f1719-7730-464c-847b-18db426bc277 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=99ce685b86cb47abba407b2e49dcf373&device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 1096 time: 0.0736566
May 28 14:21:42.080469 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8516d70e-2728-4dad-aea9-112ee36f9f93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:42.088814 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4d1fbb2a-a955-47f2-afb0-e0e356685ce8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:42.103198 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-16057dba-7f76-4e64-bd9f-4fbdd4a19b7b service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=6bfc4f29-c29d-4098-8314-02d1e6aa02a9 HTTP/1.1" status: 200  len: 217 time: 0.0617249
May 28 14:21:42.112880 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8516d70e-2728-4dad-aea9-112ee36f9f93 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=177ba268-e842-49f3-9745-45b2a571e0f8,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:42.123745 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8516d70e-2728-4dad-aea9-112ee36f9f93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:42.135154 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8516d70e-2728-4dad-aea9-112ee36f9f93 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:42.138700 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-8516d70e-2728-4dad-aea9-112ee36f9f93 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/177ba268-e842-49f3-9745-45b2a571e0f8 HTTP/1.1" status: 204  len: 168 time: 0.3681915
May 28 14:21:42.191913 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98a24f30-a8a2-429d-909a-315071350179 req-13130896-85ba-4ed7-b700-cea42b95acd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:42.194354 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-13130896-85ba-4ed7-b700-cea42b95acd6 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=c8e92692-f94e-42ef-9b0b-7db259ad1468 HTTP/1.1" status: 200  len: 851 time: 0.0794497
May 28 14:21:42.245157 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-2db9dc0d-e20c-4dc0-98c1-e2140a32bfdc service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=91ebc16a-e9fa-40de-8d8f-6fe4965dc314&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0434389
May 28 14:21:42.311812 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.90', 61303) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:42.351196 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95255ba4-8319-43f7-9496-17dba17e8903 req-b5184f12-0d7a-4fec-9b67-fc9e518a527a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:42.352998 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-95255ba4-8319-43f7-9496-17dba17e8903 req-b5184f12-0d7a-4fec-9b67-fc9e518a527a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.0910916
May 28 14:21:42.404524 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-95255ba4-8319-43f7-9496-17dba17e8903 req-21dd4d26-0b69-4260-8031-bc706186f549 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438433
May 28 14:21:42.555874 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1f296a03-1d7a-4ce0-b46b-7b84ba83d0ed req-7f921d68-d52a-4b4b-a863-b89f03724f0e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0693622
May 28 14:21:42.637958 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-4bc6c1bb-bf46-4282-a974-89eaf4f3c99d service neutron] 10.222.0.90 "GET /v2.0/networks/91ebc16a-e9fa-40de-8d8f-6fe4965dc314?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3212500
May 28 14:21:42.644837 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685200a0-3ae5-4924-95bf-10d987ed135a req-4badd4d2-d3fd-4bdf-9fb7-15306fbdd644 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:42.646216 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-4badd4d2-d3fd-4bdf-9fb7-15306fbdd644 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 819 time: 0.3051314
May 28 14:21:42.675614 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Request body: {'port': {'device_id': '9c17d712-c03d-44ac-bd8d-5f9b99160b0f', 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad', 'admin_state_up': True, 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:42.922129 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98a24f30-a8a2-429d-909a-315071350179 req-c4a3945c-3683-4773-91b1-f1ee07515aad service neutron] 10.222.0.90 "GET /v2.0/networks/91ebc16a-e9fa-40de-8d8f-6fe4965dc314?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2738218
May 28 14:21:42.926526 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:42.941604 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:43.009985 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e25993fd-6413-4ce7-b606-0655618ef3bd req-d6a8a15e-91c7-459f-b622-7e5681a5e7c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0430665
May 28 14:21:43.125327 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Made reservation on behalf of 71fbb9d6a3b643238579cd1698ca83e1 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:43.129039 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:43.437982 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Allocated IP 172.20.0.6 (1145a91e-035d-40fe-813b-06d960bbe8ad/741b5b05-e852-43d4-a973-49d123a472b9/a600bf0f-8706-4c30-ae48-005a0b8b9b84) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:43.446502 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-0b3a5ebb-f4b1-4eb2-b2ee-2e0ea247ee97 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:43.448027 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-0b3a5ebb-f4b1-4eb2-b2ee-2e0ea247ee97 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 819 time: 0.2410591
May 28 14:21:43.475635 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Request body: {'port': {'device_id': '5800de57-f9fa-4ca8-9f94-a8880f3c595f', 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad', 'admin_state_up': True, 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:43.744365 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dade0e4c-5ee1-4fc1-bb18-c64589ec689d req-b92cc311-2d01-4d3a-bf2e-c7cf5770c4e3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0655177
May 28 14:21:43.906247 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:43.926278 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Usage tracker for resource:port and tenant:71fbb9d6a3b643238579cd1698ca83e1 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:43.931539 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Quota usage for port was recalculated. Used quota:1. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:43.946993 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 req-33b43cf8-e863-4631-967f-adf586c69fe9 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:43.948508 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 req-33b43cf8-e863-4631-967f-adf586c69fe9 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.3672400
May 28 14:21:43.952293 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:44.012618 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:44.048199 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8ee7d796-c5ba-4b47-8e18-65b33c0d4604 req-269267aa-71dd-4b1a-b947-d24ee778de70 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0835364
May 28 14:21:44.082371 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Made reservation on behalf of 71fbb9d6a3b643238579cd1698ca83e1 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:44.087135 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:44.204694 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:44.229085 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-16ad087b-2c66-442a-9ada-76f85d6a086f req-21b40f88-d085-4f20-883d-053363a14f9f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0744455
May 28 14:21:44.258027 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:44.328100 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Network 1145a91e-035d-40fe-813b-06d960bbe8ad is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:44.334441 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:44.343862 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:44.394211 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Allocated IP 172.20.0.7 (1145a91e-035d-40fe-813b-06d960bbe8ad/741b5b05-e852-43d4-a973-49d123a472b9/9328e999-33b7-4ad7-9796-283089726539) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:44.408764 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Pushing event updated for resources: {'Port': ['ID=a600bf0f-8706-4c30-ae48-005a0b8b9b84,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:44.433527 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:44.461219 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:44.461219 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:44.557544 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.90', 61312) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:44.648954 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.9792812
May 28 14:21:44.763860 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Request body: {'port': {'device_id': '9c17d712-c03d-44ac-bd8d-5f9b99160b0f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:44.842944 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-fc62ce69-7200-48b6-94a4-ca320c27b612 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:44.846628 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-fc62ce69-7200-48b6-94a4-ca320c27b612 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 817 time: 0.2891772
May 28 14:21:44.889263 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:44.955899 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-035bce26-f408-4276-be7e-d0466c01fe43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3bbdb80ac64d4db395d276876322e7b0 HTTP/1.1" status: 200  len: 379 time: 0.0929482
May 28 14:21:44.975183 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'port': {'device_id': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'admin_state_up': True, 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'security_groups': ['d2a399b1-c1b2-4892-8b44-28943526ac96']}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:45.010173 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-598dd367-f87d-47f1-b8d1-686e251b2b3e req-d303d710-9db0-4c29-9cef-94f99c67c993 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Synchronizing usage tracker for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:45.047276 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:45.131824 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:45.152717 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:45.201250 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-598dd367-f87d-47f1-b8d1-686e251b2b3e req-d303d710-9db0-4c29-9cef-94f99c67c993 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Unset dirty status for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:45.202392 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-598dd367-f87d-47f1-b8d1-686e251b2b3e req-d303d710-9db0-4c29-9cef-94f99c67c993 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.2516973
May 28 14:21:45.218147 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:45.230588 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:45.293449 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Made reservation on behalf of 3bbdb80ac64d4db395d276876322e7b0 for: {'port': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:45.297397 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:45.328439 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Network 1145a91e-035d-40fe-813b-06d960bbe8ad is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:45.340589 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209c2ca4-d0b8-449e-9144-83289364218d req-8a85fd83-e85a-4391-a1b1-39604444f16a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:45.342567 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-209c2ca4-d0b8-449e-9144-83289364218d req-8a85fd83-e85a-4391-a1b1-39604444f16a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.1356173
May 28 14:21:45.382552 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:45.405557 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:45.449989 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Pushing event updated for resources: {'Port': ['ID=9328e999-33b7-4ad7-9796-283089726539,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:45.465811 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:45.466871 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-209c2ca4-d0b8-449e-9144-83289364218d req-4de677e5-6247-463b-a0e8-6da489e46d1f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0752184
May 28 14:21:45.533979 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e20dba7a-d50a-4c2a-ad58-2f4908765b3c req-8a8c737c-3cda-437c-9cc3-a53300e3c493 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.0738287
May 28 14:21:45.552989 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:45.553581 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:45.563658 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Allocated IP 172.20.0.7 (936c4847-d3d4-4250-b543-dc72dd308858/a33b117b-9151-4e0d-a39e-2f027719309f/c2872b93-4077-4bc0-8619-140f73de2a3a) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:21:45.683493 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a600bf0f-8706-4c30-ae48-005a0b8b9b84 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:21:45.691308 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:45.702495 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.2332723
May 28 14:21:45.712035 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Transition to ACTIVE for port object a600bf0f-8706-4c30-ae48-005a0b8b9b84 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:45.717905 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Request body: {'port': {'device_id': '5800de57-f9fa-4ca8-9f94-a8880f3c595f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:45.838964 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:45.843474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:45.844093 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:45.857316 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.provisioning_blocks [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Transition to ACTIVE for port object c2872b93-4077-4bc0-8619-140f73de2a3a will not be triggered until provisioned by entity DHCP. {{(pid=92694) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:45.944436 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:46.011705 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:46.020438 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:46.095755 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Network 936c4847-d3d4-4250-b543-dc72dd308858 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:21:46.099548 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:46.102190 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:21:46.108182 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:46.108802 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for port, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:46.127864 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Pushing event updated for resources: {'Port': ['ID=a600bf0f-8706-4c30-ae48-005a0b8b9b84,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:46.150320 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:46.159933 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:46.164552 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:46.257819 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2874475
May 28 14:21:46.272315 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Request body: {'port': {'device_id': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:46.353125 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Attempting to bind port a600bf0f-8706-4c30-ae48-005a0b8b9b84 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:21:46.353465 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Attempting to bind port a600bf0f-8706-4c30-ae48-005a0b8b9b84 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:21:46.353790 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Attempting to bind port a600bf0f-8706-4c30-ae48-005a0b8b9b84 on network 1145a91e-035d-40fe-813b-06d960bbe8ad {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:46.363829 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Port a600bf0f-8706-4c30-ae48-005a0b8b9b84 on network 1145a91e-035d-40fe-813b-06d960bbe8ad not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:21:46.364160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Attempting to bind port a600bf0f-8706-4c30-ae48-005a0b8b9b84 on network 1145a91e-035d-40fe-813b-06d960bbe8ad {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:46.393514 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 21, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:21:46.393779 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Checking segment: {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:46.394188 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Bound using segment: {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:21:46.394637 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Bound port: a600bf0f-8706-4c30-ae48-005a0b8b9b84, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:21:46.394982 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:46.424015 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:46.440793 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-2e5cb730-8ec4-4137-a979-9576824d910c None None] Provisioning for port c2872b93-4077-4bc0-8619-140f73de2a3a completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:46.450307 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-2e5cb730-8ec4-4137-a979-9576824d910c None None] Provisioning complete for port c2872b93-4077-4bc0-8619-140f73de2a3a triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:46.451321 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2e5cb730-8ec4-4137-a979-9576824d910c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:46.597147 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-2e5cb730-8ec4-4137-a979-9576824d910c None None] Port c2872b93-4077-4bc0-8619-140f73de2a3a cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:21:46.605350 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] For port a600bf0f-8706-4c30-ae48-005a0b8b9b84, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:21:46.609484 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] For port a600bf0f-8706-4c30-ae48-005a0b8b9b84, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:21:46.704851 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:46.763511 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9328e999-33b7-4ad7-9796-283089726539 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:21:46.780220 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ca95622c-7f94-4aa4-9758-daaffb7d8617 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:46.826778 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa req-001e0210-d32d-4141-96c4-52eccdc5dee8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:46.833937 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa req-001e0210-d32d-4141-96c4-52eccdc5dee8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 931 time: 0.3654752
May 28 14:21:46.843189 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:46.880942 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:46.882018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:46.882909 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] 10.222.0.90 "PUT /v2.0/ports/a600bf0f-8706-4c30-ae48-005a0b8b9b84 HTTP/1.1" status: 200  len: 1093 time: 2.1304958
May 28 14:21:46.884460 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c17d712-c03d-44ac-bd8d-5f9b99160b0f', 'tag': 'a600bf0f-8706-4c30-ae48-005a0b8b9b84'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:21:46.901152 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Transition to ACTIVE for port object 9328e999-33b7-4ad7-9796-283089726539 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:46.917987 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Pushing event updated for resources: {'Port': ['ID=a600bf0f-8706-4c30-ae48-005a0b8b9b84,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:46.921793 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:46.941211 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 req-83dbfeb3-6518-49df-a9e6-20711c0d18c9 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:46.943630 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 req-83dbfeb3-6518-49df-a9e6-20711c0d18c9 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.2432008
May 28 14:21:46.985601 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa req-9262453c-7d01-4c22-b4cb-bd205d3cf43b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Synchronizing usage tracker for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:46.997587 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:47.017990 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d4e9cb46-1fe6-4e6c-a83b-29780c74c8f6 req-555b2198-2ee3-42d9-80e4-c5953c600437 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0662689
May 28 14:21:47.030315 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:47.110017 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa req-9262453c-7d01-4c22-b4cb-bd205d3cf43b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Unset dirty status for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:47.111287 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4bb8b90a-377e-47ed-8918-7d98acc8c5aa req-9262453c-7d01-4c22-b4cb-bd205d3cf43b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2765722
May 28 14:21:47.142238 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c2872b93-4077-4bc0-8619-140f73de2a3a {{(pid=92694) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:21:47.151082 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:47.167092 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.provisioning_blocks [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Transition to ACTIVE for port object c2872b93-4077-4bc0-8619-140f73de2a3a will not be triggered until provisioned by entity L2. {{(pid=92694) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:21:47.252752 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c17d712-c03d-44ac-bd8d-5f9b99160b0f', 'tag': 'a600bf0f-8706-4c30-ae48-005a0b8b9b84', 'status': 'completed', 'code': 200}
May 28 14:21:47.285127 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:47.289202 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-098a5dfa-36c6-4eba-baf5-4d9f0b521ec6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:47.359874 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Pushing event updated for resources: {'Port': ['ID=9328e999-33b7-4ad7-9796-283089726539,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:47.368107 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.338s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:47.412991 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685200a0-3ae5-4924-95bf-10d987ed135a req-3fed11b2-ac20-46c9-b994-e6933f5cea60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:47.414472 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-3fed11b2-ac20-46c9-b994-e6933f5cea60 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1096 time: 0.3854773
May 28 14:21:47.425639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Attempting to bind port 9328e999-33b7-4ad7-9796-283089726539 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:21:47.425975 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Attempting to bind port 9328e999-33b7-4ad7-9796-283089726539 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:21:47.426339 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Attempting to bind port 9328e999-33b7-4ad7-9796-283089726539 on network 1145a91e-035d-40fe-813b-06d960bbe8ad {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:47.457702 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:47.460353 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:47.484622 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.managers [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Attempting to bind port c2872b93-4077-4bc0-8619-140f73de2a3a on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92694) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:21:47.484988 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.managers [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Attempting to bind port c2872b93-4077-4bc0-8619-140f73de2a3a by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'}] {{(pid=92694) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:21:47.485340 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Attempting to bind port c2872b93-4077-4bc0-8619-140f73de2a3a on network 936c4847-d3d4-4250-b543-dc72dd308858 {{(pid=92694) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:47.491211 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Port c2872b93-4077-4bc0-8619-140f73de2a3a on network 936c4847-d3d4-4250-b543-dc72dd308858 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92694) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:21:47.491526 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Attempting to bind port c2872b93-4077-4bc0-8619-140f73de2a3a on network 936c4847-d3d4-4250-b543-dc72dd308858 {{(pid=92694) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:47.497119 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 21, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92694) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:21:47.498381 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Checking segment: {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:47.498381 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Bound using segment: {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'} {{(pid=92694) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:21:47.498547 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.managers [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Bound port: c2872b93-4077-4bc0-8619-140f73de2a3a, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'}}] {{(pid=92694) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:21:47.498836 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:47.503038 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207a7bd0-522b-4d82-b833-d297c04cf307 req-6fab8ac2-a93f-4488-a47d-8705c55d96fa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:47.510785 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-207a7bd0-522b-4d82-b833-d297c04cf307 req-6fab8ac2-a93f-4488-a47d-8705c55d96fa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 931 time: 0.3273973
May 28 14:21:47.533803 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-9499cf58-cec0-439f-af3b-5d5b947e2798 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84 HTTP/1.1" status: 200  len: 217 time: 0.1092994
May 28 14:21:47.534347 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Port 9328e999-33b7-4ad7-9796-283089726539 on network 1145a91e-035d-40fe-813b-06d960bbe8ad not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:21:47.534668 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Attempting to bind port 9328e999-33b7-4ad7-9796-283089726539 on network 1145a91e-035d-40fe-813b-06d960bbe8ad {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:21:47.579787 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 21, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:21:47.580025 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Checking segment: {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:47.580412 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Bound using segment: {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:21:47.580858 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Bound port: 9328e999-33b7-4ad7-9796-283089726539, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:21:47.581659 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:47.596156 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, cleared binding levels {{(pid=92694) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:21:47.601554 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92694) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:21:47.656565 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-207a7bd0-522b-4d82-b833-d297c04cf307 req-c7d3db4d-2412-4026-ab3a-7207163e2279 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Synchronizing usage tracker for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:security_group {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:47.692077 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685200a0-3ae5-4924-95bf-10d987ed135a req-7df228a5-dcf3-4e84-9892-3b648854ed80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:47.692994 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-7df228a5-dcf3-4e84-9892-3b648854ed80 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.1494150
May 28 14:21:47.695592 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:47.704596 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-207a7bd0-522b-4d82-b833-d297c04cf307 req-c7d3db4d-2412-4026-ab3a-7207163e2279 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Unset dirty status for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:security_group {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:47.708489 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:47.708953 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-207a7bd0-522b-4d82-b833-d297c04cf307 req-c7d3db4d-2412-4026-ab3a-7207163e2279 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1969879
May 28 14:21:47.790133 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:47.790756 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for port, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:47.792341 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] 10.222.0.90 "PUT /v2.0/ports/c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 200  len: 1093 time: 1.5249512
May 28 14:21:47.792832 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:21:47.891480 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] For port 9328e999-33b7-4ad7-9796-283089726539, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:21:47.894797 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] For port 9328e999-33b7-4ad7-9796-283089726539, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=9328e999-33b7-4ad7-9796-283089726539,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:21:47.904461 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-9c8cee4a-60bc-48a4-9bef-c4e81d6f03bd service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1853588
May 28 14:21:47.930244 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=3']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:47.938853 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:48.080265 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:48.113112 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:48.128849 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-3e028327-ea66-456b-8ddf-7a21548e1625 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:48.131009 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-3e028327-ea66-456b-8ddf-7a21548e1625 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1096 time: 0.1624658
May 28 14:21:48.197849 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Pushing event updated for resources: {'Port': ['ID=9328e999-33b7-4ad7-9796-283089726539,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:48.208203 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:48.227468 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:48.227468 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:48.227468 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] 10.222.0.90 "PUT /v2.0/ports/9328e999-33b7-4ad7-9796-283089726539 HTTP/1.1" status: 200  len: 1093 time: 2.5062439
May 28 14:21:48.281642 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-87260d9c-5947-4a59-b877-6c574e25d98b service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3631516
May 28 14:21:48.298974 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-5a9f8596-ded4-4e0c-8bce-ecaf2e1db773 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 200  len: 217 time: 0.1552775
May 28 14:21:48.385506 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-c0939f87-6f67-4c5a-a1cb-e987cff19ead service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:48.386909 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-c0939f87-6f67-4c5a-a1cb-e987cff19ead service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.0793729
May 28 14:21:48.440397 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce req-55ad5363-ba36-4224-abf2-ad7d7dd28c82 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:48.441924 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce req-55ad5363-ba36-4224-abf2-ad7d7dd28c82 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 943 time: 0.1950607
May 28 14:21:48.503099 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0aa009f7-6a51-43a6-a7a8-d7414dfba7ce req-d14ebeda-c65e-4068-b669-9e7615de367d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0544615
May 28 14:21:48.516907 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-adfba8b1-7e0b-4372-a7de-46b0d1d560bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:48.518454 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-adfba8b1-7e0b-4372-a7de-46b0d1d560bd service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1239548
May 28 14:21:48.579135 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685200a0-3ae5-4924-95bf-10d987ed135a req-09a029a5-f9d4-4b9d-bd66-1993855ed178 service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2896166
May 28 14:21:48.586967 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf69107c-080e-4223-a8b2-8d118653e453 req-daf29880-8b2d-43fe-8fe3-64afe2bc3e6c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:48.594278 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf69107c-080e-4223-a8b2-8d118653e453 req-daf29880-8b2d-43fe-8fe3-64afe2bc3e6c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 943 time: 0.2721725
May 28 14:21:48.633792 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-e5bacc70-6ad4-42df-b2f9-0be3b9a86d1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:48.633792 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-e5bacc70-6ad4-42df-b2f9-0be3b9a86d1d service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 1096 time: 0.2718430
May 28 14:21:48.660914 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'status': 'completed', 'code': 200}
May 28 14:21:48.721897 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-b80687ff-f7ce-46ad-b1e6-b74f699c4a49 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9328e999-33b7-4ad7-9796-283089726539 HTTP/1.1" status: 200  len: 217 time: 0.0765002
May 28 14:21:48.730957 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-d7fb167f-aaec-4380-9a62-0dc127a250e0 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2023354
May 28 14:21:48.762833 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf69107c-080e-4223-a8b2-8d118653e453 req-2b3545bb-3d5e-45d1-b1aa-9a4006acee67 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1676731
May 28 14:21:48.847033 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-f5ed59ff-f95e-4000-99b2-5bc908ee8085 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:48.848612 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-f5ed59ff-f95e-4000-99b2-5bc908ee8085 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0892987
May 28 14:21:48.901497 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-84163d74-fa8f-487a-b1a6-6262b20f24fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:48.905819 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-84163d74-fa8f-487a-b1a6-6262b20f24fb service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1096 time: 0.1828923
May 28 14:21:48.909953 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-88a3fa08-a5de-4a16-b01f-f7cea7f094f7 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0529048
May 28 14:21:49.009355 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc84f8ae-3443-429a-8b9d-61c7fb106a43 req-c770fb46-c03b-444b-a218-6b99a6d09a5d service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2647767
May 28 14:21:49.039544 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30702902-aa6d-42e2-ac4f-5aad7777860e req-efbf9886-cd52-43b9-b364-22bd2140557b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:49.041041 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-30702902-aa6d-42e2-ac4f-5aad7777860e req-efbf9886-cd52-43b9-b364-22bd2140557b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Synchronizing usage tracker for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:21:49.153952 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-30702902-aa6d-42e2-ac4f-5aad7777860e req-efbf9886-cd52-43b9-b364-22bd2140557b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Unset dirty status for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:21:49.155155 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-30702902-aa6d-42e2-ac4f-5aad7777860e req-efbf9886-cd52-43b9-b364-22bd2140557b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.2461669
May 28 14:21:49.231444 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-f9c732ad-7295-4d67-8242-5486ab93eaf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:49.232976 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-f9c732ad-7295-4d67-8242-5486ab93eaf3 service neutron] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 920 time: 0.3111401
May 28 14:21:49.234780 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-14a27129-1eac-4737-9735-c39a6435d986 service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3116188
May 28 14:21:49.255920 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-30702902-aa6d-42e2-ac4f-5aad7777860e req-056bed66-5b4e-4045-b5e3-735e76a46422 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0546944
May 28 14:21:49.272507 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5800de57-f9fa-4ca8-9f94-a8880f3c595f', 'tag': '9328e999-33b7-4ad7-9796-283089726539'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:21:49.275950 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f58f25b-4618-4241-ba75-13e161051784 req-9a8e45ba-49b0-44b6-a9e1-417f479c4aa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:49.277400 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9f58f25b-4618-4241-ba75-13e161051784 req-9a8e45ba-49b0-44b6-a9e1-417f479c4aa5 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1096 time: 0.1179993
May 28 14:21:49.305975 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:21:49.359615 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-90b807fc-0c1c-4bc4-a43f-9d2a855fcbb1 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84 HTTP/1.1" status: 200  len: 217 time: 0.1137164
May 28 14:21:49.407868 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5800de57-f9fa-4ca8-9f94-a8880f3c595f', 'tag': '9328e999-33b7-4ad7-9796-283089726539', 'status': 'completed', 'code': 200}
May 28 14:21:49.485384 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,segment=NetworkSegment(5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811),segment_id=5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:49.502735 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-f30c5df5-f198-46ce-9a13-9cfa12c6fb55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:49.504190 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-f30c5df5-f198-46ce-9a13-9cfa12c6fb55 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0983114
May 28 14:21:49.506245 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f58f25b-4618-4241-ba75-13e161051784 req-a76e35b4-d6e1-497c-943a-59db66e7aa1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:49.506558 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '6bfc4f29-c29d-4098-8314-02d1e6aa02a9', 'network_id': '91ebc16a-e9fa-40de-8d8f-6fe4965dc314', 'port_id': '6bfc4f29-c29d-4098-8314-02d1e6aa02a9', 'mac_address': 'fa:16:3e:eb:f9:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 887, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c8e92692-f94e-42ef-9b0b-7db259ad1468', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:21:49.508316 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9f58f25b-4618-4241-ba75-13e161051784 req-a76e35b4-d6e1-497c-943a-59db66e7aa1b service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.2193069
May 28 14:21:49.560255 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-0827f71a-09ee-427f-a258-5e904e90d07a service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0429633
May 28 14:21:49.563806 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-73ebe19f-50b6-4778-ac1d-4a5eef093336 req-35d8f6aa-540f-4620-bab1-537a2753e12e service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3165729
May 28 14:21:49.571317 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:49.588615 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:21:49.604777 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,segment=NetworkSegment(5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811),segment_id=5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:49.605851 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9f58f25b-4618-4241-ba75-13e161051784 req-bdb797b4-860a-4bb9-9bc4-46ceaa357f87 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 200  len: 217 time: 0.0883315
May 28 14:21:49.666016 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:49.670589 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-6a2bd2de-918e-4483-aead-0c236943c1de None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:49.804460 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:49.813803 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:49.820106 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f58f25b-4618-4241-ba75-13e161051784 req-e59cd282-9d06-421d-8c3b-0e3c66d8715c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:49.821949 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9f58f25b-4618-4241-ba75-13e161051784 req-e59cd282-9d06-421d-8c3b-0e3c66d8715c service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.2061036
May 28 14:21:49.930870 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-fb826fd6-b694-4c72-9528-7c01f968d61b service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3540032
May 28 14:21:49.935108 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-ccc532ef-5365-4bab-b564-51eb7a732349 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:49.936747 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-ccc532ef-5365-4bab-b564-51eb7a732349 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 1096 time: 0.1771314
May 28 14:21:49.987540 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5bf6b01-7d05-44e5-8b90-3703542122db req-824a5ded-676f-4608-8d51-592c3709c3ed tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:49.993506 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e5bf6b01-7d05-44e5-8b90-3703542122db req-824a5ded-676f-4608-8d51-592c3709c3ed tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 944 time: 0.3415153
May 28 14:21:50.028412 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f58f25b-4618-4241-ba75-13e161051784 req-f751c5e2-2d54-4273-a541-0b3c470c88df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:50.029583 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9f58f25b-4618-4241-ba75-13e161051784 req-f751c5e2-2d54-4273-a541-0b3c470c88df service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1888583
May 28 14:21:50.077853 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e5bf6b01-7d05-44e5-8b90-3703542122db req-52864080-dac8-4275-9380-82ccb4408fd5 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0797708
May 28 14:21:50.208874 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9f58f25b-4618-4241-ba75-13e161051784 req-a7246c5d-baa1-49d9-9d23-b658c050818f service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1691723
May 28 14:21:50.319152 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-598cbacd-e9f6-4634-8d61-39328416899d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:50.320763 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-598cbacd-e9f6-4634-8d61-39328416899d service neutron] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 920 time: 0.3353231
May 28 14:21:50.328576 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 req-9f81a570-241e-4202-aea3-469e593433a5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:50.330151 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 req-9f81a570-241e-4202-aea3-469e593433a5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 943 time: 0.3462098
May 28 14:21:50.384311 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9f58f25b-4618-4241-ba75-13e161051784 req-8db44f0d-f69a-4757-96ca-248d91448e14 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1625922
May 28 14:21:50.399487 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-601542cf-1268-4cf6-8c9a-e8e4345d047c req-679b415d-fad7-4d3a-94f5-92d1af98949f service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4588816
May 28 14:21:50.413195 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-fa0d2c24-2125-438a-8a1c-3a6480934a5e service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9328e999-33b7-4ad7-9796-283089726539 HTTP/1.1" status: 200  len: 217 time: 0.0800908
May 28 14:21:50.496827 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206de4a6-091f-45c5-831b-0efdf8bbe38f req-ac1b92b4-8547-4108-809a-d09e11550535 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:50.498667 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-206de4a6-091f-45c5-831b-0efdf8bbe38f req-ac1b92b4-8547-4108-809a-d09e11550535 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0925968
May 28 14:21:50.500082 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-666e6de2-95dc-4846-a331-7d4d5b7c3a14 req-d9a6da09-12ba-4527-a796-d073dedc5e78 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1125085
May 28 14:21:50.528234 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-de4573a4-f7bb-4f18-9e6c-9ef610f74226 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:50.529665 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-de4573a4-f7bb-4f18-9e6c-9ef610f74226 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0976250
May 28 14:21:50.546733 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56840) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:50.556748 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-206de4a6-091f-45c5-831b-0efdf8bbe38f req-08a45ac8-5aa3-4f1a-b6f6-5fdf5485c225 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0494032
May 28 14:21:50.579859 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-21b79d41-beb5-471e-b702-79576590cfca service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0419762
May 28 14:21:50.675746 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:50.690266 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:50.696372 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Usage tracker for resource:security_group_rule and tenant:7e20f922735743228855b574675c1b37 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:50.697583 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:50.703480 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:50.716641 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-8e4bc8c4-78cc-48f8-a093-1b3e81af382d service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1281209
May 28 14:21:50.787470 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:50.820756 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['6bfc4f29-c29d-4098-8314-02d1e6aa02a9'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:21:50.850793 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:50.851020 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b2ed8308-89ce-40d5-9888-ffa40dc0c0da req-5ce18794-6168-44ab-8716-46d298579dbd service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1275470
May 28 14:21:50.864174 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:50.903913 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=7e20f922735743228855b574675c1b37&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3558955
May 28 14:21:50.905574 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=467afe0e-d693-4cc2-978e-f436a3a8d373,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:50.906522 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56846) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:50.908754 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:50.965372 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b4a7b211-de51-46a9-8400-697c0e974666 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:50.993483 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b4a7b211-de51-46a9-8400-697c0e974666 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:51.102746 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b4a7b211-de51-46a9-8400-697c0e974666 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:51.106471 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:51.121922 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a7b211-de51-46a9-8400-697c0e974666 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=467afe0e-d693-4cc2-978e-f436a3a8d373,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:51.125568 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b4a7b211-de51-46a9-8400-697c0e974666 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:51.128882 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b4a7b211-de51-46a9-8400-697c0e974666 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:51.138623 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-b4a7b211-de51-46a9-8400-697c0e974666 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/467afe0e-d693-4cc2-978e-f436a3a8d373 HTTP/1.1" status: 204  len: 168 time: 0.2291627
May 28 14:21:51.281253 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acca2c3-caa6-447f-ae13-312c105010aa req-ba0943d5-d558-4fac-b888-b1f261035f91 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:51.282813 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1acca2c3-caa6-447f-ae13-312c105010aa req-ba0943d5-d558-4fac-b888-b1f261035f91 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 944 time: 0.0822439
May 28 14:21:51.329682 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1acca2c3-caa6-447f-ae13-312c105010aa req-007ad432-6c79-473e-a3f9-34efff40b118 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401306
May 28 14:21:51.742016 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4ae335-aae2-4687-a320-36a9aab75f8d req-48078b85-9675-460a-a70e-3bfe9a21282e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:51.749653 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cd4ae335-aae2-4687-a320-36a9aab75f8d req-48078b85-9675-460a-a70e-3bfe9a21282e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 943 time: 0.1297591
May 28 14:21:51.765186 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56888) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:51.788315 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:51.794937 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cd4ae335-aae2-4687-a320-36a9aab75f8d req-b43f320e-95b7-4078-9bd2-9c0368c2509d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444653
May 28 14:21:51.807476 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:51.813804 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Usage tracker for resource:security_group_rule and tenant:2acf6e6e19004fd38abe57e3b0e86793 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:51.817488 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:51.824441 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:51.842043 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d0de6a1-47c9-42ad-b248-0506d34b256f req-fc70c29e-ef21-42a3-b1c6-574acb2da1ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:51.843461 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d0de6a1-47c9-42ad-b248-0506d34b256f req-fc70c29e-ef21-42a3-b1c6-574acb2da1ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1439683
May 28 14:21:51.906773 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d0de6a1-47c9-42ad-b248-0506d34b256f req-7d8dfa9a-c182-4cae-90ec-8fc99299657b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0536990
May 28 14:21:51.972099 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:52.031896 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:52.051569 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:52.091578 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=2acf6e6e19004fd38abe57e3b0e86793&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3258679
May 28 14:21:52.094093 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56906) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:52.096757 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c6b3d4d-1270-4efc-90b6-179f3b2dca21,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:52.112147 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:52.163380 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3bb9338b-1828-4529-a1f5-9837e761f73d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:52.190876 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3bb9338b-1828-4529-a1f5-9837e761f73d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:52.337562 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3bb9338b-1828-4529-a1f5-9837e761f73d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:52.341690 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:52.352799 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bb9338b-1828-4529-a1f5-9837e761f73d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c6b3d4d-1270-4efc-90b6-179f3b2dca21,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:52.355123 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3bb9338b-1828-4529-a1f5-9837e761f73d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:52.368240 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3bb9338b-1828-4529-a1f5-9837e761f73d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:52.371860 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-3bb9338b-1828-4529-a1f5-9837e761f73d admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/8c6b3d4d-1270-4efc-90b6-179f3b2dca21 HTTP/1.1" status: 204  len: 168 time: 0.2742765
May 28 14:21:52.549455 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 56926) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:52.560624 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97f6037-7d47-445e-9897-8723dd5f60a8 req-1bdf1749-d1c0-4c5c-bf7c-ba2c5b30be26 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:52.568607 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e97f6037-7d47-445e-9897-8723dd5f60a8 req-1bdf1749-d1c0-4c5c-bf7c-ba2c5b30be26 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 944 time: 0.1253438
May 28 14:21:52.622590 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e97f6037-7d47-445e-9897-8723dd5f60a8 req-529c9a0a-4d47-43a5-938a-8666d9ee02ee tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0530343
May 28 14:21:52.821129 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:52.844752 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:52.844752 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Usage tracker for resource:security_group_rule and tenant:6a5c4899efc04c51b35e8f33793de4cb is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:52.848419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:52.860612 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:53.096607 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.122029 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 req-432dcf0a-5c53-4f37-a25e-e67ac8e32c04 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:53.123597 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 req-432dcf0a-5c53-4f37-a25e-e67ac8e32c04 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 943 time: 0.1950142
May 28 14:21:53.171343 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-93d4cc06-ca97-452b-bb37-eabd22d9d2f5 req-803f04cf-e5ef-4659-99eb-7656665ef387 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400116
May 28 14:21:53.178162 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd37c455-f90b-4aab-903c-b1fce1508d11 req-78ae9ca5-a4cd-4471-bbe8-95849c2f3b20 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:53.179662 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cd37c455-f90b-4aab-903c-b1fce1508d11 req-78ae9ca5-a4cd-4471-bbe8-95849c2f3b20 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0849299
May 28 14:21:53.211162 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.219676 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9200226a-6d72-48d6-b1ec-0306db67e4c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:53.228962 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cd37c455-f90b-4aab-903c-b1fce1508d11 req-2ba1ef4e-41ae-42b6-914e-7e764c71a6ea tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0436423
May 28 14:21:53.266373 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=6a5c4899efc04c51b35e8f33793de4cb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7156792
May 28 14:21:53.267327 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e35ab86b-6941-44eb-9893-990c434fa17c,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:53.269055 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 56960) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:53.270694 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:53.310234 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device a600bf0f-8706-4c30-ae48-005a0b8b9b84 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:21:53.341205 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-09141eb0-8317-4629-b7fc-c1ba26a270bc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.373595 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-09141eb0-8317-4629-b7fc-c1ba26a270bc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.392320 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:53.497976 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port a600bf0f-8706-4c30-ae48-005a0b8b9b84, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:53.517630 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'a600bf0f-8706-4c30-ae48-005a0b8b9b84', 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad', 'port_id': 'a600bf0f-8706-4c30-ae48-005a0b8b9b84', 'mac_address': 'fa:16:3e:60:f4:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 850, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '741b5b05-e852-43d4-a973-49d123a472b9', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:21:53.543068 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-09141eb0-8317-4629-b7fc-c1ba26a270bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.556486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f3327b55-e74e-4715-9fc3-4da0a7733c07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:53.569097 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09141eb0-8317-4629-b7fc-c1ba26a270bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e35ab86b-6941-44eb-9893-990c434fa17c,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:53.573282 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-09141eb0-8317-4629-b7fc-c1ba26a270bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:53.574240 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.579515 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-09141eb0-8317-4629-b7fc-c1ba26a270bc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.579515 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-09141eb0-8317-4629-b7fc-c1ba26a270bc admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/e35ab86b-6941-44eb-9893-990c434fa17c HTTP/1.1" status: 204  len: 168 time: 0.3064618
May 28 14:21:53.603324 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a600bf0f-8706-4c30-ae48-005a0b8b9b84 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:21:53.620822 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port a600bf0f-8706-4c30-ae48-005a0b8b9b84, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:53.629424 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:53.635757 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:53.636546 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.766655 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.770631 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:53.830952 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:53.862202 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=a600bf0f-8706-4c30-ae48-005a0b8b9b84,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:53.866804 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:53.871478 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2da8b01f-1c47-4118-bc09-bffde9f331b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6bfc4f29-c29d-4098-8314-02d1e6aa02a9'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:21:53.882485 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ca7c13-ca67-481b-b411-477e05cc54ae req-ba5373a2-ee10-4c73-a0cc-67b6f9a9fbb3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:53.889464 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a2ca7c13-ca67-481b-b411-477e05cc54ae req-ba5373a2-ee10-4c73-a0cc-67b6f9a9fbb3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 944 time: 0.1070313
May 28 14:21:53.939795 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,segment=NetworkSegment(5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811),segment_id=5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:53.947211 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a2ca7c13-ca67-481b-b411-477e05cc54ae req-77241ef0-6b76-4710-bdf2-44bb658e1194 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0566993
May 28 14:21:53.999754 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:54.002139 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:54.071129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:54.074562 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:54.161466 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['a600bf0f-8706-4c30-ae48-005a0b8b9b84'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:21:54.408220 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57014) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:54.437404 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:54.438943 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2da8b01f-1c47-4118-bc09-bffde9f331b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6bfc4f29-c29d-4098-8314-02d1e6aa02a9', 'code': 200}
May 28 14:21:54.458783 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:54.463257 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Usage tracker for resource:security_group_rule and tenant:a8cbe73326a34d6eb4d014cbaa83156d is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:54.466327 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:54.472626 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:54.578247 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55684b8e-ad61-444f-b60a-17f31b08ecb4 req-23fc67b0-62a5-444c-b655-b9b738632198 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:54.585925 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-55684b8e-ad61-444f-b60a-17f31b08ecb4 req-23fc67b0-62a5-444c-b655-b9b738632198 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 943 time: 0.2410586
May 28 14:21:54.590346 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:54.648441 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-55684b8e-ad61-444f-b60a-17f31b08ecb4 req-cb6d2b46-d325-411c-a57a-d2ff880396ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0614283
May 28 14:21:54.685755 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:54.695385 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9d8e0d9d-d279-4777-836c-10965d94fda8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:54.745438 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a8cbe73326a34d6eb4d014cbaa83156d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3360741
May 28 14:21:54.746561 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63e9fae0-7a67-4c0f-8d28-726acf80bc9a,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:54.748978 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57024) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:54.751395 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:54.792077 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9094da-fac0-4ab7-9637-b5799cea1e19 req-2da4015d-bc12-4a45-8499-8791a5536c00 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:54.805596 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ab9094da-fac0-4ab7-9637-b5799cea1e19 req-2da4015d-bc12-4a45-8499-8791a5536c00 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1902604
May 28 14:21:54.860386 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-968cdbc3-6586-4594-a9cb-12975011b243 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:54.910570 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ab9094da-fac0-4ab7-9637-b5799cea1e19 req-02f30990-664e-4f49-bfd3-46d494c94854 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0967753
May 28 14:21:54.913689 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-968cdbc3-6586-4594-a9cb-12975011b243 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:54.949784 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-cb843ca3-8665-4a1b-b4cb-be55a81a806c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:54.952352 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-cb843ca3-8665-4a1b-b4cb-be55a81a806c service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 1098 time: 0.0999064
May 28 14:21:54.978609 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:54.994741 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:54.998749 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Usage tracker for resource:security_group_rule and tenant:3123682734e1406685b2002b168d852b is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:55.002045 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:55.008453 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:55.110513 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-968cdbc3-6586-4594-a9cb-12975011b243 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:55.119095 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2753e634-fb02-4306-95c1-8dea06b40a66 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:55.139390 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968cdbc3-6586-4594-a9cb-12975011b243 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63e9fae0-7a67-4c0f-8d28-726acf80bc9a,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:55.143919 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-968cdbc3-6586-4594-a9cb-12975011b243 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:55.153681 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-968cdbc3-6586-4594-a9cb-12975011b243 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:55.153681 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-968cdbc3-6586-4594-a9cb-12975011b243 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/63e9fae0-7a67-4c0f-8d28-726acf80bc9a HTTP/1.1" status: 204  len: 168 time: 0.3987434
May 28 14:21:55.188362 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 req-cbbde7e1-a9df-458b-be56-0dca699040b7 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:55.190109 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 req-cbbde7e1-a9df-458b-be56-0dca699040b7 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.1251280
May 28 14:21:55.213475 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:55.244081 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c53e4876-06f6-4a1e-bdcc-7e641f9dfbd2 req-cefb41a1-200e-4da0-93e3-85383eb17d33 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473430
May 28 14:21:55.268585 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:55.282073 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5458240c-8f18-478c-86fb-fe7518c71b27 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:55.312101 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 9328e999-33b7-4ad7-9796-283089726539 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:21:55.314591 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device a600bf0f-8706-4c30-ae48-005a0b8b9b84 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:55.317817 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6a4c2f66-e3fe-404b-bcc5-7339ec12bcdc req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3576949
May 28 14:21:55.325774 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=b7cd9fe3-9492-443e-9778-325c419e7252,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:55.328950 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:55.510307 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 9328e999-33b7-4ad7-9796-283089726539, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=9328e999-33b7-4ad7-9796-283089726539,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:55.529154 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '9328e999-33b7-4ad7-9796-283089726539', 'network_id': '1145a91e-035d-40fe-813b-06d960bbe8ad', 'port_id': '9328e999-33b7-4ad7-9796-283089726539', 'mac_address': 'fa:16:3e:da:02:e5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 850, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '741b5b05-e852-43d4-a973-49d123a472b9', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:21:55.562941 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port a600bf0f-8706-4c30-ae48-005a0b8b9b84 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:55.593439 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port a600bf0f-8706-4c30-ae48-005a0b8b9b84 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:55.594589 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:55.683094 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:55.742245 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9328e999-33b7-4ad7-9796-283089726539 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:21:55.794224 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 9328e999-33b7-4ad7-9796-283089726539, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=9328e999-33b7-4ad7-9796-283089726539,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:55.796997 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:55.846728 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port a600bf0f-8706-4c30-ae48-005a0b8b9b84, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:55.886009 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:55.886774 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:21:55.888911 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:55.946418 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:55.961237 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08898b1-3e2b-470c-861c-07ee389e8713 req-5d96fa8d-d9a0-4081-9d08-104d20f6360f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:55.969546 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e08898b1-3e2b-470c-861c-07ee389e8713 req-5d96fa8d-d9a0-4081-9d08-104d20f6360f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 944 time: 0.1059926
May 28 14:21:56.010012 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=9328e999-33b7-4ad7-9796-283089726539,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:56.017397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:56.025324 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-81068cd9-b53c-4fb4-b411-9a905602769d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.074s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:56.047503 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e08898b1-3e2b-470c-861c-07ee389e8713 req-c6799347-eae6-4018-8def-2d29624f30a9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0766222
May 28 14:21:56.225813 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c req-7add9d26-17ae-438c-b3fd-e844c48d2957 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:56.230477 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=a600bf0f-8706-4c30-ae48-005a0b8b9b84,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:56.233736 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c req-7add9d26-17ae-438c-b3fd-e844c48d2957 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1555943
May 28 14:21:56.235368 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:56.260617 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:56.287139 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'port_id': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'mac_address': 'fa:16:3e:f8:88:b6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 869, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:21:56.289543 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3f7b5d3f-1486-4ee8-810f-715bc0b69f3c req-e2c48521-5065-4868-989d-5b30fd9af3ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0546999
May 28 14:21:56.384896 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:56.405452 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c2872b93-4077-4bc0-8619-140f73de2a3a {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:21:56.421677 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:56.443129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c17d712-c03d-44ac-bd8d-5f9b99160b0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a600bf0f-8706-4c30-ae48-005a0b8b9b84'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:21:56.492530 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c17d712-c03d-44ac-bd8d-5f9b99160b0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a600bf0f-8706-4c30-ae48-005a0b8b9b84', 'code': 200}
May 28 14:21:56.492622 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 req-51c9ab14-17e0-4183-97d5-9bad496b770a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:56.492622 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 req-51c9ab14-17e0-4183-97d5-9bad496b770a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0874436
May 28 14:21:56.521298 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:56.527082 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:56.563973 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f2b45cf5-240f-47ff-ba54-d10ec4a6ed53 req-1661afe2-3d0c-452d-9bfa-eaaa0bd6e7f3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0665071
May 28 14:21:56.608476 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:56.611547 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:56.658481 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57100) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:56.771978 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1305891357-network', 'tenant_id': 'f850196b4c014b48b9dd79a436895e8a'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:56.776631 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:56.780474 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Usage tracker for resource:network and tenant:f850196b4c014b48b9dd79a436895e8a is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:56.783299 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:56.789507 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:56.897370 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Made reservation on behalf of f850196b4c014b48b9dd79a436895e8a for: {'network': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:56.899734 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:56.912847 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:56.930390 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:56.934443 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Usage tracker for resource:security_group_rule and tenant:f850196b4c014b48b9dd79a436895e8a is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:56.944177 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:56.953165 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:56.966620 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54d2defa-b189-4f22-ad84-2ff9935da17c req-9a8fbae1-0791-4598-a477-0e0745b430ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:56.971316 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-54d2defa-b189-4f22-ad84-2ff9935da17c req-9a8fbae1-0791-4598-a477-0e0745b430ff service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1098 time: 0.0786071
May 28 14:21:57.013401 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-54d2defa-b189-4f22-ad84-2ff9935da17c req-90682dc6-9a67-4f17-af5f-52236f17502a service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0366583
May 28 14:21:57.048212 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.109026 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.115691 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:57.147818 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] vlan segment allocate from pool success with {'vlan_id': 872, 'physical_network': 'physnet1'}  {{(pid=92694) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:21:57.157114 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58726f5c-17e6-4114-8f7d-22d900bb7a12,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:57.158104 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['9328e999-33b7-4ad7-9796-283089726539'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:21:57.162544 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:57.170994 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 57116) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:57.199128 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.199128 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.segments_db [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Added segment 877899c7-fd92-41e8-8048-ed89094c1e44 of type vlan for network 6b02addc-afca-4b17-a9ca-45bef6a29ad9
May 28 14:21:57.203654 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['c2872b93-4077-4bc0-8619-140f73de2a3a'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:21:57.248044 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.295065 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca req-3054d8e9-a8dc-499a-8746-f7fb2dd31281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:57.296791 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca req-3054d8e9-a8dc-499a-8746-f7fb2dd31281 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 944 time: 0.1332929
May 28 14:21:57.319735 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.339501 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:57.344807 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Usage tracker for resource:security_group_rule and tenant:7ba4bc903e3649909baeb27326a84f9f is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:57.348005 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:57.356881 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:57.390572 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-64bfa10c-cab5-4b1a-9b8d-5143064c39ca req-868dce41-90f4-4672-9433-6694362767cc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0793998
May 28 14:21:57.457172 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.461049 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:57.461969 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.469145 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6a245379-ea64-4afb-96f0-85adc1d338d9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:57.512822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.538563 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 req-30f875c7-d8b6-4ad3-a395-b70fe11a5591 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:57.540016 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 req-30f875c7-d8b6-4ad3-a395-b70fe11a5591 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.1212895
May 28 14:21:57.547227 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:21:57.593296 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Pushing event updated for resources: {'Network': ['ID=6b02addc-afca-4b17-a9ca-45bef6a29ad9,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:57.596375 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:57.604681 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-62ec9c35-a9ff-4c2b-8ba4-28dcac72c3f0 req-c3c6db30-ef2e-48d2-b462-a040dd265055 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0582716
May 28 14:21:57.604820 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 6b02addc-afca-4b17-a9ca-45bef6a29ad9 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:21:57.605847 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.626996 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-26f68cb7-a8a1-46d7-a412-4786188df012 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:57.669870 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=7ba4bc903e3649909baeb27326a84f9f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4977629
May 28 14:21:57.672635 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57132) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:57.673032 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0bdeb56-a6ef-4f85-b5d5-28a97410a766,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:57.676051 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:57.703586 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.0398772
May 28 14:21:57.705627 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 57136) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:57.712262 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Request body: {'subnet': {'network_id': '6b02addc-afca-4b17-a9ca-45bef6a29ad9', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1305891357-subnet', 'tenant_id': 'f850196b4c014b48b9dd79a436895e8a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:21:57.717281 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:57.721601 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Usage tracker for resource:subnet and tenant:f850196b4c014b48b9dd79a436895e8a is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:57.725523 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:57.736120 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:57.814751 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-72769098-13e2-4353-b2e4-223bd3e5e87a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.839952 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 req-a33af630-c4b7-45b4-9b87-74df5b958e3d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:57.841390 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 req-a33af630-c4b7-45b4-9b87-74df5b958e3d tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.1370537
May 28 14:21:57.846159 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.849747 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Made reservation on behalf of f850196b4c014b48b9dd79a436895e8a for: {'subnet': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:21:57.852118 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1808138'] for subnet, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.874919 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-72769098-13e2-4353-b2e4-223bd3e5e87a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:57.921445 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-eaf0c13e-cd30-4676-8c75-319f0fd0cce6 req-9c14b7cc-bf49-413b-b663-22e83d5eb485 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0730462
May 28 14:21:58.011038 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-72769098-13e2-4353-b2e4-223bd3e5e87a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:58.016193 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d1bf1cb3-b200-44cb-b38a-92d6f6b15aa0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:58.037187 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72769098-13e2-4353-b2e4-223bd3e5e87a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0bdeb56-a6ef-4f85-b5d5-28a97410a766,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:58.040429 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-72769098-13e2-4353-b2e4-223bd3e5e87a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:58.042518 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-72769098-13e2-4353-b2e4-223bd3e5e87a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:58.045931 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-72769098-13e2-4353-b2e4-223bd3e5e87a admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/f0bdeb56-a6ef-4f85-b5d5-28a97410a766 HTTP/1.1" status: 204  len: 168 time: 0.3697786
May 28 14:21:58.617650 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1635813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1808156'] for subnet, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:58.625487 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b8e92f07-2584-493c-baf3-0224a0b1b782 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:58.696503 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c46ba7-459a-4fd0-a4ec-419087274682 req-d41b071b-772e-4dcb-88f3-2fd7d207316e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:58.697989 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-19c46ba7-459a-4fd0-a4ec-419087274682 req-d41b071b-772e-4dcb-88f3-2fd7d207316e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 944 time: 0.1908133
May 28 14:21:58.726456 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=58490f39-86f2-45b0-85f6-38ca44011b6a,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:58.732347 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:58.754047 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Checking segment: {'id': '877899c7-fd92-41e8-8048-ed89094c1e44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': '6b02addc-afca-4b17-a9ca-45bef6a29ad9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:21:58.754411 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Network hostable DHCP agents. Network: 6b02addc-afca-4b17-a9ca-45bef6a29ad9, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92695) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:21:58.772476 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-19c46ba7-459a-4fd0-a4ec-419087274682 req-fc3b5be4-1e1d-4825-a976-6fa739389c4b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0670006
May 28 14:21:58.845504 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e30c731e-6ae1-48eb-9eb0-494b06642996 req-391d7a03-3eb1-43bc-a48c-880d3602d248 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:58.847998 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e30c731e-6ae1-48eb-9eb0-494b06642996 req-391d7a03-3eb1-43bc-a48c-880d3602d248 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.1062648
May 28 14:21:58.857227 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Network 6b02addc-afca-4b17-a9ca-45bef6a29ad9 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92695) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:21:58.867053 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 57164) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:58.885076 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:58.900455 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e30c731e-6ae1-48eb-9eb0-494b06642996 req-5c936eda-6251-40ad-b153-26e7764dd8e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0464911
May 28 14:21:58.903714 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:21:58.907746 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Usage tracker for resource:security_group_rule and tenant:225207689e4f4548a963d067f349f86e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:21:58.910568 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:21:58.926815 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:21:58.957592 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 6b02addc-afca-4b17-a9ca-45bef6a29ad9) {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:21:58.969237 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c04aa20-7d2b-4222-a587-5a77c4997bc1 None None] Network 6b02addc-afca-4b17-a9ca-45bef6a29ad9 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:59.024865 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:59.025439 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.103939 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.172829 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e req-c2840b04-b3fc-4ea5-b2ab-97b40c0536f3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:21:59.180140 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e req-c2840b04-b3fc-4ea5-b2ab-97b40c0536f3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.1312666
May 28 14:21:59.196116 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-098acbec-83b3-4008-b5c8-71889529e101 None None] Network 6b02addc-afca-4b17-a9ca-45bef6a29ad9 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:21:59.202470 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.240695 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cb404381-8280-49d3-b87c-7da015b5b837 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:59.326309 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.6194942
May 28 14:21:59.336725 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=225207689e4f4548a963d067f349f86e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4685953
May 28 14:21:59.342452 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 9328e999-33b7-4ad7-9796-283089726539 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:59.343987 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57178) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:21:59.355203 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ea63497c-70f4-4bda-8cd5-d4ebe2952a5e req-edd740f0-8391-4ded-bd25-72082677fda6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1737747
May 28 14:21:59.356800 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5886a9c-a308-4c3d-a448-3f75d7a108f7,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:59.359747 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:59.440574 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f06b25aa-260b-42e7-aa6a-6633cbe05b26 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.480270 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f06b25aa-260b-42e7-aa6a-6633cbe05b26 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.617296 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 9328e999-33b7-4ad7-9796-283089726539 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:21:59.622484 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 9328e999-33b7-4ad7-9796-283089726539 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:21:59.622859 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.640226 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f06b25aa-260b-42e7-aa6a-6633cbe05b26 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.643933 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:21:59.656025 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f06b25aa-260b-42e7-aa6a-6633cbe05b26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5886a9c-a308-4c3d-a448-3f75d7a108f7,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:21:59.659369 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f06b25aa-260b-42e7-aa6a-6633cbe05b26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:21:59.666653 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f06b25aa-260b-42e7-aa6a-6633cbe05b26 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.668916 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-f06b25aa-260b-42e7-aa6a-6633cbe05b26 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/d5886a9c-a308-4c3d-a448-3f75d7a108f7 HTTP/1.1" status: 204  len: 168 time: 0.3214631
May 28 14:21:59.767519 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.806209 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5800de57-f9fa-4ca8-9f94-a8880f3c595f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9328e999-33b7-4ad7-9796-283089726539'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:21:59.819209 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 9328e999-33b7-4ad7-9796-283089726539, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=9328e999-33b7-4ad7-9796-283089726539,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:21:59.926096 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5800de57-f9fa-4ca8-9f94-a8880f3c595f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9328e999-33b7-4ad7-9796-283089726539', 'code': 200}
May 28 14:21:59.931748 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:21:59.932836 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:21:59.971234 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:00.068399 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=9328e999-33b7-4ad7-9796-283089726539,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:00.072619 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:00.076209 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3a4ec8b3-fb06-421d-ba1c-bbe1b4a6f6a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:00.205214 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a7b204-10f0-4c13-9e81-e19db9e78f8d req-1ebbf054-e950-4cea-ab6e-f7a53fd10d09 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:00.214711 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-00a7b204-10f0-4c13-9e81-e19db9e78f8d req-1ebbf054-e950-4cea-ab6e-f7a53fd10d09 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.1495624
May 28 14:22:00.226156 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8768276-4498-45d9-8af8-4611d7c8e335 req-f0c1dc80-b68a-4088-bc5a-3ca3248ec3df tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:00.227824 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d8768276-4498-45d9-8af8-4611d7c8e335 req-f0c1dc80-b68a-4088-bc5a-3ca3248ec3df tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1970198
May 28 14:22:00.281736 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-00a7b204-10f0-4c13-9e81-e19db9e78f8d req-28955df4-be8d-4c39-a24a-941e2b64a7bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0660112
May 28 14:22:00.286939 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port c2872b93-4077-4bc0-8619-140f73de2a3a completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:22:00.298852 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d8768276-4498-45d9-8af8-4611d7c8e335 req-68890ea1-6558-48ad-926c-c0c6f4db8715 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0588953
May 28 14:22:00.299101 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port c2872b93-4077-4bc0-8619-140f73de2a3a triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:22:00.299101 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:00.543125 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b55f3172-8cc6-4201-9788-e4ae37a21673 req-f7478ad8-a485-472a-8f04-c0c9e3a88ba3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:00.548359 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b55f3172-8cc6-4201-9788-e4ae37a21673 req-f7478ad8-a485-472a-8f04-c0c9e3a88ba3 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 1098 time: 0.1612320
May 28 14:22:00.584826 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:00.607733 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-b55f3172-8cc6-4201-9788-e4ae37a21673 req-77979974-d77b-48ad-b8bd-b9658edb4370 service neutron] Synchronizing usage tracker for tenant:3123682734e1406685b2002b168d852b on resource:security_group {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:22:00.640895 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:22:00.669677 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57236) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:00.675261 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-742500099-network', 'tenant_id': 'a1a272a6daf142fca2c547421c2e35f9'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:22:00.680455 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:00.684407 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Usage tracker for resource:network and tenant:a1a272a6daf142fca2c547421c2e35f9 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:00.687250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:00.693094 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:00.697037 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-b55f3172-8cc6-4201-9788-e4ae37a21673 req-77979974-d77b-48ad-b8bd-b9658edb4370 service neutron] Unset dirty status for tenant:3123682734e1406685b2002b168d852b on resource:security_group {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:22:00.697184 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:00.698188 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b55f3172-8cc6-4201-9788-e4ae37a21673 req-77979974-d77b-48ad-b8bd-b9658edb4370 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1387951
May 28 14:22:00.702138 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:00.748891 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Made reservation on behalf of a1a272a6daf142fca2c547421c2e35f9 for: {'network': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:22:00.751737 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:00.768660 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:00.769033 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:00.773373 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:00.790014 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:00.794148 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Usage tracker for resource:security_group_rule and tenant:a1a272a6daf142fca2c547421c2e35f9 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:00.796964 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:00.803187 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:00.887572 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:00.942956 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:00.948117 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-99b1fdec-6e67-4620-bb34-429db3344bf2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:00.976275 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] vlan segment allocate from pool success with {'vlan_id': 860, 'physical_network': 'physnet1'}  {{(pid=92694) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:22:00.985400 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c4d88fa-8ce0-4d09-9a16-4f3ab4af006e,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:00.989633 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:00.995344 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:00.995690 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.segments_db [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Added segment 526589c8-79eb-41ed-aa41-773f51b38e74 of type vlan for network 03a86622-6f07-4ee2-8cbf-d4df121dfb51
May 28 14:22:01.023407 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:01.114512 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:01.116270 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:01.116681 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:01.122429 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:01.252434 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Pushing event updated for resources: {'Network': ['ID=03a86622-6f07-4ee2-8cbf-d4df121dfb51,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:01.252434 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:01.253513 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 03a86622-6f07-4ee2-8cbf-d4df121dfb51 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:22:01.435361 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.7645514
May 28 14:22:01.454894 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57260) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:01.462417 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Request body: {'subnet': {'network_id': '03a86622-6f07-4ee2-8cbf-d4df121dfb51', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-742500099-subnet', 'tenant_id': 'a1a272a6daf142fca2c547421c2e35f9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:22:01.470481 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:01.478165 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Usage tracker for resource:subnet and tenant:a1a272a6daf142fca2c547421c2e35f9 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:01.478898 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:01.485827 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:01.517351 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab379fd-7303-4731-be35-c43800329b5e req-4dc52451-e112-49f2-958f-d7a6cd62634b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:01.517351 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9ab379fd-7303-4731-be35-c43800329b5e req-4dc52451-e112-49f2-958f-d7a6cd62634b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1181324
May 28 14:22:01.528346 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 req-4b7701c5-868a-4d02-8a00-0b0a95125d1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:01.530014 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 req-4b7701c5-868a-4d02-8a00-0b0a95125d1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0891213
May 28 14:22:01.569801 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9ab379fd-7303-4731-be35-c43800329b5e req-044f2685-058c-40d6-9bf5-e1c39ee7e7b8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0476823
May 28 14:22:01.584585 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fd05fa2-92f9-47d6-8b23-49a94e1b9313 req-7ea42d28-e018-48d9-85d1-f19611dff0b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0482862
May 28 14:22:01.927724 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:22:01.971252 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'code': 200}
May 28 14:22:02.034113 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Made reservation on behalf of a1a272a6daf142fca2c547421c2e35f9 for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:22:02.037686 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:02.538239 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:02.548281 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b945808d-cd01-42c2-ae72-42e4851d2437 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:02.595436 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:02.601361 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:02.687734 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fafd771-a971-4c34-9456-9eb42a0fdd8f req-6728adc2-ff3b-4861-9938-09d6cbbe0940 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:02.690338 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fafd771-a971-4c34-9456-9eb42a0fdd8f req-6728adc2-ff3b-4861-9938-09d6cbbe0940 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1098 time: 0.1479871
May 28 14:22:02.757783 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ed0bc661-c04b-4e27-a52d-de9a2196d209,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:02.761750 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:02.762438 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Checking segment: {'id': '526589c8-79eb-41ed-aa41-773f51b38e74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '03a86622-6f07-4ee2-8cbf-d4df121dfb51'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:22:02.762787 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Network hostable DHCP agents. Network: 03a86622-6f07-4ee2-8cbf-d4df121dfb51, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:22:02.865531 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca49e129-6464-40e3-ba1f-be95d466411e req-c1983734-4a27-45c5-a003-6861b2a6897b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:02.866984 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ca49e129-6464-40e3-ba1f-be95d466411e req-c1983734-4a27-45c5-a003-6861b2a6897b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0899060
May 28 14:22:02.913843 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ca49e129-6464-40e3-ba1f-be95d466411e req-faf3d279-9f9b-40e1-8410-b1d490b6d8be tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409009
May 28 14:22:02.914954 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Network 03a86622-6f07-4ee2-8cbf-d4df121dfb51 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:22:02.977850 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 03a86622-6f07-4ee2-8cbf-d4df121dfb51) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:22:02.982503 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:02.983150 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:02.987589 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7271ed19-dc38-4273-9e93-bc7ce2d2683e None None] Network 03a86622-6f07-4ee2-8cbf-d4df121dfb51 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:22:03.100565 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.6446297
May 28 14:22:03.132994 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f98ae10e-a76c-420c-90b3-1e521ad95924 req-52c47719-6055-4f75-8361-08e8660a5f67 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:03.135130 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f98ae10e-a76c-420c-90b3-1e521ad95924 req-52c47719-6055-4f75-8361-08e8660a5f67 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1068754
May 28 14:22:03.214564 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f98ae10e-a76c-420c-90b3-1e521ad95924 req-416021f7-c658-48bb-9106-adcb79025410 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0732639
May 28 14:22:03.282609 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe3ae9f8-2443-41da-8f03-7b59658cfbb4 None None] Network 03a86622-6f07-4ee2-8cbf-d4df121dfb51 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:22:03.702626 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:03.884500 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f568841e-ce3f-489a-aec8-204a04ca8ca6 req-f8b11e96-157b-48fa-8549-60326172d1d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:03.886268 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f568841e-ce3f-489a-aec8-204a04ca8ca6 req-f8b11e96-157b-48fa-8549-60326172d1d3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0885751
May 28 14:22:03.938833 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f568841e-ce3f-489a-aec8-204a04ca8ca6 req-54028b46-4723-4fe9-8555-11ec9e652f7e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463152
May 28 14:22:04.334530 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fafd771-a971-4c34-9456-9eb42a0fdd8f req-76fd3860-7a6b-47f4-95c1-026957a0c5c9 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410502
May 28 14:22:04.441677 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 req-afba7159-40ba-49f3-8c74-462099fdb8de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:04.443715 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 req-afba7159-40ba-49f3-8c74-462099fdb8de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0868108
May 28 14:22:04.493644 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c4fa7007-92d4-432c-9a94-6c747eaeeea1 req-5771eac6-8ec0-4691-b60d-7b6d71c9dd4e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442238
May 28 14:22:05.126657 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633db146-7978-4971-83f7-452bafb24af6 req-3412e180-abe0-4a8f-b90d-b1d7d928d805 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:05.128028 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-633db146-7978-4971-83f7-452bafb24af6 req-3412e180-abe0-4a8f-b90d-b1d7d928d805 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0824876
May 28 14:22:05.171350 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-633db146-7978-4971-83f7-452bafb24af6 req-f4db20e0-a312-4b28-b458-5f2dd241f686 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0376804
May 28 14:22:05.268223 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:05.682202 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e0739a-a747-436b-8343-3bd5365eb767 req-a7dc0f9e-dd06-46af-bd34-156da447e646 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:05.683715 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d2e0739a-a747-436b-8343-3bd5365eb767 req-a7dc0f9e-dd06-46af-bd34-156da447e646 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0804586
May 28 14:22:05.728051 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d2e0739a-a747-436b-8343-3bd5365eb767 req-48057258-94c7-4576-8dd2-f763025cfd46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385823
May 28 14:22:06.354466 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea89b9b-8781-4217-b783-4d6112dffd42 req-6613dde6-67aa-4332-ae2c-6f04e76fb03f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:06.355875 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-eea89b9b-8781-4217-b783-4d6112dffd42 req-6613dde6-67aa-4332-ae2c-6f04e76fb03f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0783696
May 28 14:22:06.401518 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-eea89b9b-8781-4217-b783-4d6112dffd42 req-cee343b6-7f77-47e2-b1e0-0aedc14db726 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399265
May 28 14:22:06.916062 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 req-c1310058-8087-42c0-b8c7-5ad420130933 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:06.917401 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 req-c1310058-8087-42c0-b8c7-5ad420130933 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0804694
May 28 14:22:06.961286 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cf9575ea-ecd0-4bc0-8f4d-6df6632e7299 req-4980180a-edc5-4ae6-ae50-89fb1fe615f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383282
May 28 14:22:07.595866 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb5ea78-a876-40a5-9aa2-973665609f0c req-de804c68-8b62-4a83-89b7-afff40d914a0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:07.597639 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bbb5ea78-a876-40a5-9aa2-973665609f0c req-de804c68-8b62-4a83-89b7-afff40d914a0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0866821
May 28 14:22:07.644810 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bbb5ea78-a876-40a5-9aa2-973665609f0c req-435d0858-8b1c-48fb-a642-c7616fbe33c0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392778
May 28 14:22:07.798655 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-9e9f669d-7ec8-41a7-b15c-7593a8c1849c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:07.800182 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-9e9f669d-7ec8-41a7-b15c-7593a8c1849c service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 1098 time: 0.0733197
May 28 14:22:08.035813 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-a8ea7371-ccc2-40dc-8f1e-a9456fbc6e9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:08.037303 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-a8ea7371-ccc2-40dc-8f1e-a9456fbc6e9f service neutron] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 920 time: 0.1300318
May 28 14:22:08.145190 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-f1df3073-a82a-49ba-ad20-dcba8f142558 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9328e999-33b7-4ad7-9796-283089726539 HTTP/1.1" status: 200  len: 217 time: 0.0921102
May 28 14:22:08.231760 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-a6affc1e-6c2e-4427-a3f5-e215aaebbe1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:08.233175 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-a6affc1e-6c2e-4427-a3f5-e215aaebbe1f service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0775609
May 28 14:22:08.251643 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 req-549a84d9-001e-4eec-a5a5-3fe3ffb7997b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:08.252979 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 req-549a84d9-001e-4eec-a5a5-3fe3ffb7997b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1450784
May 28 14:22:08.305643 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-9f073554-c425-408b-95b0-ed33c0cfbe06 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0517802
May 28 14:22:08.394663 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c27f92a4-bc82-417b-aa7f-40d0f56a5d69 req-250928fc-3ac1-4516-a95f-2f2ab134f16a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1122317
May 28 14:22:08.454637 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-ccc5f5ae-20f8-4bd9-8893-85b576baba12 service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1356614
May 28 14:22:08.591103 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-162c77ed-cf9b-4708-b264-6b4e08e5c8ec req-7d9f7fdb-c5e2-4c92-804a-5defa4399bc9 service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1256495
May 28 14:22:08.833028 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2c3e75-cb40-466a-9948-6653881f69ee req-c4bcead0-648e-4268-85db-11b64a066dea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:08.834492 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2e2c3e75-cb40-466a-9948-6653881f69ee req-c4bcead0-648e-4268-85db-11b64a066dea tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0807161
May 28 14:22:08.879155 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2e2c3e75-cb40-466a-9948-6653881f69ee req-432bfd16-4338-447e-8555-b75b5091875c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389092
May 28 14:22:09.588950 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 req-acc8caea-9cde-4620-853d-db7bd2354a0c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:09.590447 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 req-acc8caea-9cde-4620-853d-db7bd2354a0c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0851824
May 28 14:22:09.635049 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7895f839-ddbd-4dc9-87bc-b1186a5569d5 req-d1449eaf-3efa-4139-8431-4b37dd5281f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390220
May 28 14:22:10.064195 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03ee6c9-32f5-45de-8e93-af653b26eab3 req-640cc451-4b96-4e92-95f4-6d3d84ec101c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:10.065759 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b03ee6c9-32f5-45de-8e93-af653b26eab3 req-640cc451-4b96-4e92-95f4-6d3d84ec101c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0828466
May 28 14:22:10.122491 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b03ee6c9-32f5-45de-8e93-af653b26eab3 req-e1339192-bdb4-4b7c-8994-155aca2f313c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447783
May 28 14:22:10.817867 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d4b084c-3a44-48c3-83e9-e596040da076 req-e1a46e47-ada8-48f3-8b1e-e85e4210fab3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:10.819437 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d4b084c-3a44-48c3-83e9-e596040da076 req-e1a46e47-ada8-48f3-8b1e-e85e4210fab3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0779524
May 28 14:22:10.863403 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d4b084c-3a44-48c3-83e9-e596040da076 req-68e40fca-c2f5-4b52-b268-79f8f24bb8eb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383599
May 28 14:22:11.302868 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74afd548-ce99-477f-88d3-7b9e14ac693f req-ec0b2406-c961-4223-8749-463bc6d05371 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:11.304375 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-74afd548-ce99-477f-88d3-7b9e14ac693f req-ec0b2406-c961-4223-8749-463bc6d05371 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0864251
May 28 14:22:11.353102 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-74afd548-ce99-477f-88d3-7b9e14ac693f req-2b2f8fe4-935c-4a9f-aeb7-feda96406642 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431812
May 28 14:22:12.106318 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aac0527a-759c-4af0-adce-e38a4ac6425f req-749d121d-b4ab-4864-964f-7c4f828bce0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:12.107718 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-aac0527a-759c-4af0-adce-e38a4ac6425f req-749d121d-b4ab-4864-964f-7c4f828bce0f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1334283
May 28 14:22:12.151170 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-aac0527a-759c-4af0-adce-e38a4ac6425f req-ceb0447a-d3db-4b45-89a3-ee5b4f7ad8aa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0378709
May 28 14:22:12.540702 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c824a5d-f45a-4737-8a0a-f26a91da077a req-c7da626d-d8dd-45c0-8716-9314eef6cf4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:12.542181 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7c824a5d-f45a-4737-8a0a-f26a91da077a req-c7da626d-d8dd-45c0-8716-9314eef6cf4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0814965
May 28 14:22:12.586877 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7c824a5d-f45a-4737-8a0a-f26a91da077a req-7db71995-958d-41a3-b1b3-4c28819c9533 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389802
May 28 14:22:13.340630 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 req-a6a5c907-b5af-4b18-a668-81f9ae036307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:13.342120 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 req-a6a5c907-b5af-4b18-a668-81f9ae036307 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0802045
May 28 14:22:13.386393 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c3158af-b3f8-4d61-a8ca-9b96d1beb313 req-0be9f7a7-d891-475b-884a-1201085fd28a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387676
May 28 14:22:13.797116 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4dfef77-b509-420a-9785-f9baddfae39a req-44e6594d-cabd-4764-9cd6-d18295ab2416 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:13.798603 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f4dfef77-b509-420a-9785-f9baddfae39a req-44e6594d-cabd-4764-9cd6-d18295ab2416 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0869548
May 28 14:22:13.844198 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f4dfef77-b509-420a-9785-f9baddfae39a req-12d5fa39-e786-4692-9790-bfeb526f8ee0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387230
May 28 14:22:14.575959 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81e32cb-6629-4c18-9116-98406dd28501 req-b2933800-284e-4cda-ae81-8c72f1a58386 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:14.577460 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c81e32cb-6629-4c18-9116-98406dd28501 req-b2933800-284e-4cda-ae81-8c72f1a58386 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0818527
May 28 14:22:14.624167 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c81e32cb-6629-4c18-9116-98406dd28501 req-e9df359c-ac51-4082-9ba1-5cd28ae97b40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399685
May 28 14:22:14.813974 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f29dd8-3db7-43a4-a04b-bae60ae14dfc req-de2ebe0a-2a8c-4f9d-be41-df942c93c01d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:14.816239 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c4f29dd8-3db7-43a4-a04b-bae60ae14dfc req-de2ebe0a-2a8c-4f9d-be41-df942c93c01d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0823448
May 28 14:22:14.832422 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57538) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:14.837563 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-e6f067f2-f03a-4b2a-bd4f-c354ad5e4908 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'floatingip': {'port_id': 'c2872b93-4077-4bc0-8619-140f73de2a3a'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:22:14.921555 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6f067f2-f03a-4b2a-bd4f-c354ad5e4908 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:15.040825 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d req-ffa2fe39-3803-4d3c-9086-d82e6204b7f9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:15.042290 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d req-ffa2fe39-3803-4d3c-9086-d82e6204b7f9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0836813
May 28 14:22:15.087635 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4b270eb6-01bb-4237-b1ab-f4bbe8f74d1d req-ce36eec5-dbfb-4242-b915-6b2262d29405 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388594
May 28 14:22:15.748283 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6f067f2-f03a-4b2a-bd4f-c354ad5e4908 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:15.811664 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6f067f2-f03a-4b2a-bd4f-c354ad5e4908 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:15.986032 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.l3_db [None req-e6f067f2-f03a-4b2a-bd4f-c354ad5e4908 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Floating IP b83e86bc-99fc-48f9-9a53-cdd2efc8a060 associated. External IP: 172.27.3.190, port: c2872b93-4077-4bc0-8619-140f73de2a3a.
May 28 14:22:16.419112 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6f067f2-f03a-4b2a-bd4f-c354ad5e4908 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Router 93611a0c-a5d3-438a-bf94-7453623f231d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:22:16.427574 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701795c1-dd06-4ac4-8e19-e226fa2c66de req-1d16165b-3deb-499f-a66a-6467f6fa85e9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:16.429014 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-701795c1-dd06-4ac4-8e19-e226fa2c66de req-1d16165b-3deb-499f-a66a-6467f6fa85e9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.2092433
May 28 14:22:16.453275 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 57586) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:16.576566 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:16.591800 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:16.595771 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Usage tracker for resource:security_group_rule and tenant:2b9b765fceb64f598674235446060501 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:16.599254 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:16.605098 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:16.637385 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-701795c1-dd06-4ac4-8e19-e226fa2c66de req-90888296-e85b-4c0b-9e21-0f915f21dbfe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2006788
May 28 14:22:16.702661 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:16.727736 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6f067f2-f03a-4b2a-bd4f-c354ad5e4908 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:22:16.732691 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6f067f2-f03a-4b2a-bd4f-c354ad5e4908 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:16.744563 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] Sync routers for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:22:16.758085 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:22:16.759142 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba22f6490>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:22:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:22:16.792391 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e6f067f2-f03a-4b2a-bd4f-c354ad5e4908 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "PUT /v2.0/floatingips/b83e86bc-99fc-48f9-9a53-cdd2efc8a060 HTTP/1.1" status: 200  len: 991 time: 1.9586968
May 28 14:22:16.793072 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:22:16.826535 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:16.837039 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8748991e-7713-4c5c-9218-81ff8ce6c7a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:16.856085 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'status': 'completed', 'code': 200}
May 28 14:22:16.888217 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=2b9b765fceb64f598674235446060501&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4338706
May 28 14:22:16.890810 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db38e14c-402d-4d7d-ba53-60ce57252a26,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:16.890924 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57604) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:16.899239 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.900016 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.900603 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.901137 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.901668 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.902204 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.902741 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.903432 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.904020 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.904557 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.905189 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.905710 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:16.910243 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:16.963998 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:16.987945 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:22:16.998974 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:17.125277 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:17.130854 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-72769098-13e2-4353-b2e4-223bd3e5e87a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:17.141359 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db38e14c-402d-4d7d-ba53-60ce57252a26,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:17.152424 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.152863 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.157111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:22:17.158706 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:17.159848 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/db38e14c-402d-4d7d-ba53-60ce57252a26 HTTP/1.1" status: 204  len: 168 time: 0.2679498
May 28 14:22:17.161354 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:17.353529 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba22f6490>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'b83e86bc-99fc-48f9-9a53-cdd2efc8a060', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'floating_ip_address': '172.27.3.190', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'port_id': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 105, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'mac_address': 'fa:16:3e:f8:88:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:21:24Z', 'updated_at': '2021-05-28T14:22:15Z', 'revision_number': 1, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:22:17.357363 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] Checking router: 93611a0c-a5d3-438a-bf94-7453623f231d for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:22:17.366354 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:22:17.366937 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba22f6490>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:22:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:22:17.541597 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:22:17.838781 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a344210-8835-4df6-b1a5-6d79b1911c7b req-9937fbaf-b756-4e18-8ebc-d63ef21971b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:17.840392 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5a344210-8835-4df6-b1a5-6d79b1911c7b req-9937fbaf-b756-4e18-8ebc-d63ef21971b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0890086
May 28 14:22:17.885918 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5a344210-8835-4df6-b1a5-6d79b1911c7b req-07a36065-9370-46c8-9586-8780a47f515e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399847
May 28 14:22:17.931236 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba22f6490>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'b83e86bc-99fc-48f9-9a53-cdd2efc8a060', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'floating_ip_address': '172.27.3.190', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'port_id': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 105, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'mac_address': 'fa:16:3e:f8:88:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:21:24Z', 'updated_at': '2021-05-28T14:22:15Z', 'revision_number': 1, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:22:17.935108 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa0dce0e-b458-4405-a8a5-4541c76a2cd0 None None] The sync data for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi is: [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'b83e86bc-99fc-48f9-9a53-cdd2efc8a060', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'floating_ip_address': '172.27.3.190', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'port_id': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 105, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'mac_address': 'fa:16:3e:f8:88:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:21:24Z', 'updated_at': '2021-05-28T14:22:15Z', 'revision_number': 1, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:22:17.964611 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57618) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:17.981980 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:17.998078 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:18.002315 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Usage tracker for resource:security_group_rule and tenant:0cb33eac352745a98f2c0da63d4eef4e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:18.006063 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:18.012873 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:18.110739 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:18.150295 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bf788ff-84f6-408a-9bb4-609be68321c8 None None] New status for floating IP b83e86bc-99fc-48f9-9a53-cdd2efc8a060: ACTIVE {{(pid=92696) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:22:18.274311 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:18.281574 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:18.324508 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=0cb33eac352745a98f2c0da63d4eef4e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3587446
May 28 14:22:18.325486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ceca6b50-fa28-4087-871f-d34dda231e1f,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:18.327343 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 57628) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:18.329168 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:18.389949 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-90b820f3-1d69-44a5-ae77-0d71e7c7cb1e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:18.418269 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-90b820f3-1d69-44a5-ae77-0d71e7c7cb1e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:18.639913 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-90b820f3-1d69-44a5-ae77-0d71e7c7cb1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:18.644745 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:18.659633 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90b820f3-1d69-44a5-ae77-0d71e7c7cb1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ceca6b50-fa28-4087-871f-d34dda231e1f,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:18.662913 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-90b820f3-1d69-44a5-ae77-0d71e7c7cb1e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:18.667987 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-90b820f3-1d69-44a5-ae77-0d71e7c7cb1e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:18.671363 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-90b820f3-1d69-44a5-ae77-0d71e7c7cb1e admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/ceca6b50-fa28-4087-871f-d34dda231e1f HTTP/1.1" status: 204  len: 168 time: 0.3407683
May 28 14:22:19.068821 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8839539-6056-4be5-8217-bd459c8de3fe req-763dcb06-516b-4820-af4c-488229d02ed1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:19.070368 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d8839539-6056-4be5-8217-bd459c8de3fe req-763dcb06-516b-4820-af4c-488229d02ed1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0813682
May 28 14:22:19.119896 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d8839539-6056-4be5-8217-bd459c8de3fe req-e6ff98e6-b1f9-4df9-b3dc-08e7ea480f99 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430522
May 28 14:22:20.307234 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 req-7786e0ba-2b62-4f80-b318-6e6874b54405 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:20.308651 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 req-7786e0ba-2b62-4f80-b318-6e6874b54405 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0822146
May 28 14:22:20.353477 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2fe0e284-c407-4d81-9a7e-17547fd22bf0 req-e6fc8ea2-c7ba-4447-be54-4dc706c5aca2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391726
May 28 14:22:20.702997 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-69c372c0-fbf2-457c-92d6-11110e5120ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:20.704481 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-69c372c0-fbf2-457c-92d6-11110e5120ba service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1098 time: 0.0739274
May 28 14:22:20.846078 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-bf325a8c-6c41-4715-ad3b-ace8c1451307 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:20.847527 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-bf325a8c-6c41-4715-ad3b-ace8c1451307 service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.1313393
May 28 14:22:20.960645 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-afbfd85a-dd33-46f1-9b79-a64341d4e253 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 200  len: 1001 time: 0.1012998
May 28 14:22:21.034267 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-55b3f957-4459-437b-bc36-e992fbfddef3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:21.036725 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-55b3f957-4459-437b-bc36-e992fbfddef3 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.0652015
May 28 14:22:21.125138 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-8cb9254c-a6ca-4be8-8aea-f6971a31efcb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:21.126601 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-8cb9254c-a6ca-4be8-8aea-f6971a31efcb service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0797873
May 28 14:22:21.262693 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-30d84c64-0a14-461f-a693-a8f4e9b9fa54 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1258655
May 28 14:22:21.399644 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-56d2c4e4-305a-420d-8f54-055ac7f8f055 req-8abc03cf-1d63-44d4-83b8-486d9d3f64d5 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1260989
May 28 14:22:21.537058 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805c63a8-e342-44c3-be07-5c8ddc070ff7 req-bebf0bdc-f047-474a-8e04-a19a0dae5d4e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:21.538504 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-805c63a8-e342-44c3-be07-5c8ddc070ff7 req-bebf0bdc-f047-474a-8e04-a19a0dae5d4e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0790777
May 28 14:22:21.585479 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-805c63a8-e342-44c3-be07-5c8ddc070ff7 req-8f74f327-53eb-4518-9cfb-d5aea25b3a86 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413122
May 28 14:22:22.778993 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088c807b-f181-4cc0-a5aa-e442f068b749 req-0456d51d-5dec-43d1-bbdd-af3714730f28 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:22.780462 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-088c807b-f181-4cc0-a5aa-e442f068b749 req-0456d51d-5dec-43d1-bbdd-af3714730f28 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0881903
May 28 14:22:22.828566 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-088c807b-f181-4cc0-a5aa-e442f068b749 req-7bdeb9a0-ed83-48bb-be8e-9bcb2066c3ff tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422499
May 28 14:22:23.822026 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-70ade27e-51b0-479e-a56d-ea5c716edf18 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0746007
May 28 14:22:23.975218 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57742) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:24.079310 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-bae7fe0b-f078-479c-9147-de0276a5159d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:24.084877 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-bae7fe0b-f078-479c-9147-de0276a5159d service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=99ce685b86cb47abba407b2e49dcf373&device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 1098 time: 0.1678314
May 28 14:22:24.098410 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 req-853918bd-816d-44a0-9750-8eac5e8ffc10 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:24.100193 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 req-853918bd-816d-44a0-9750-8eac5e8ffc10 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1091847
May 28 14:22:24.152804 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0732e778-797a-4475-a1bd-afd5d4f7b2b1 req-dde85f8a-e6e0-4fc7-a914-d85f4c6ea3df tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466232
May 28 14:22:24.174188 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:24.189251 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:24.193425 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Usage tracker for resource:security_group_rule and tenant:6d36130a692d4c708dddd3ba10c91fb3 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:24.196367 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:24.202002 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:24.274378 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-8b2fa020-d104-4e68-9f1b-7f781d4e2216 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:24.275922 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-8b2fa020-d104-4e68-9f1b-7f781d4e2216 service neutron] 10.222.0.90 "GET /v2.0/networks?id=91ebc16a-e9fa-40de-8d8f-6fe4965dc314 HTTP/1.1" status: 200  len: 912 time: 0.1603971
May 28 14:22:24.298189 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:24.409844 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:24.415738 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:24.427603 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-4eaa0674-1989-4bfa-9321-e1b99195898e service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=6bfc4f29-c29d-4098-8314-02d1e6aa02a9 HTTP/1.1" status: 200  len: 217 time: 0.1284168
May 28 14:22:24.458635 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=6d36130a692d4c708dddd3ba10c91fb3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4821279
May 28 14:22:24.461315 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57760) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:24.463972 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48bde754-5659-4242-b008-61085c7ba92c,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:24.475968 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:24.500062 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-728d6bb3-4171-4ac4-ba3b-5cb5e0efc6d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:24.501550 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-728d6bb3-4171-4ac4-ba3b-5cb5e0efc6d8 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=c8e92692-f94e-42ef-9b0b-7db259ad1468 HTTP/1.1" status: 200  len: 851 time: 0.0603118
May 28 14:22:24.522967 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d3fec155-f40b-4b2a-91d5-bfc9e2e50145 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:24.552374 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d3fec155-f40b-4b2a-91d5-bfc9e2e50145 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:24.553990 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-ca81b96d-bef4-4c4f-a3b4-b6dcd6ebaa7d service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=91ebc16a-e9fa-40de-8d8f-6fe4965dc314&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0412171
May 28 14:22:24.692124 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d3fec155-f40b-4b2a-91d5-bfc9e2e50145 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:24.704124 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-863d5cb7-3d4a-47c7-86b9-676f37d4a8ff service neutron] 10.222.0.90 "GET /v2.0/networks/91ebc16a-e9fa-40de-8d8f-6fe4965dc314?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1265652
May 28 14:22:24.704679 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0ebb94ac-b0e0-48a0-97fa-455156fead8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:24.723877 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3fec155-f40b-4b2a-91d5-bfc9e2e50145 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48bde754-5659-4242-b008-61085c7ba92c,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:24.726313 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d3fec155-f40b-4b2a-91d5-bfc9e2e50145 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:24.731642 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d3fec155-f40b-4b2a-91d5-bfc9e2e50145 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:24.736443 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-d3fec155-f40b-4b2a-91d5-bfc9e2e50145 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/48bde754-5659-4242-b008-61085c7ba92c HTTP/1.1" status: 204  len: 168 time: 0.2735972
May 28 14:22:25.356933 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af0d124-dd60-486f-b09d-9c9688f114e8 req-fa7fcbce-7472-43c1-8e2c-7cfa59238220 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:25.358492 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0af0d124-dd60-486f-b09d-9c9688f114e8 req-fa7fcbce-7472-43c1-8e2c-7cfa59238220 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0906322
May 28 14:22:25.404277 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0af0d124-dd60-486f-b09d-9c9688f114e8 req-30fb446a-de5e-42b2-ac2d-d57d446aaf76 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389299
May 28 14:22:25.432549 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 57794) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:25.450574 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:25.469689 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:25.473894 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Usage tracker for resource:security_group_rule and tenant:1cf283ca7f8648289b6f788576ccfe92 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:25.476502 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:25.482246 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:25.567195 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:25.645757 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:25.652871 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-24567595-c0ce-4355-93e9-74bc46ba7a03 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:25.693641 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=1cf283ca7f8648289b6f788576ccfe92&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2603757
May 28 14:22:25.694500 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8638c799-3ea8-423e-895b-f4ba763f6bb2,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:25.696605 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57802) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:25.698654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:25.756270 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-20e79778-4d94-460b-9a6b-6e34f0168e06 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:25.781178 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-20e79778-4d94-460b-9a6b-6e34f0168e06 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:25.965025 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-20e79778-4d94-460b-9a6b-6e34f0168e06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:25.968848 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:25.979377 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e79778-4d94-460b-9a6b-6e34f0168e06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8638c799-3ea8-423e-895b-f4ba763f6bb2,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:25.984589 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-20e79778-4d94-460b-9a6b-6e34f0168e06 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:25.986170 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-20e79778-4d94-460b-9a6b-6e34f0168e06 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:25.987262 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-20e79778-4d94-460b-9a6b-6e34f0168e06 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/8638c799-3ea8-423e-895b-f4ba763f6bb2 HTTP/1.1" status: 204  len: 168 time: 0.2889855
May 28 14:22:26.595965 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75af9630-810e-4cbb-b01e-1a2776de2429 req-17a3c186-3841-45e3-815d-ba69b2c1d6c9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:26.598915 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-75af9630-810e-4cbb-b01e-1a2776de2429 req-17a3c186-3841-45e3-815d-ba69b2c1d6c9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0876336
May 28 14:22:26.649162 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-75af9630-810e-4cbb-b01e-1a2776de2429 req-147c9cb1-8d9d-4e7a-b39e-ce88759eb905 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444946
May 28 14:22:26.871133 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e0157e24-e1fe-4b8d-af53-9c6de372f176 req-fdd4c77e-5d1b-428f-99b1-ae23b9c47c8a service neutron] 10.222.0.90 "GET /v2.0/networks/91ebc16a-e9fa-40de-8d8f-6fe4965dc314?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1285207
May 28 14:22:27.794197 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:27.979800 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 req-297e6bc2-262e-49d7-ae05-10721a90da89 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:27.981316 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 req-297e6bc2-262e-49d7-ae05-10721a90da89 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0806601
May 28 14:22:28.044069 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-aea3e6a7-a80a-4e95-80e9-e11a07099bf7 req-eef6f686-e8fa-40d3-a838-43f368fb14be tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515041
May 28 14:22:29.225316 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60dedccb-f348-4c4d-a88e-80e0ff72d458 req-60d9ed45-c52d-4212-8bbd-ed175af4845a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:29.226862 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-60dedccb-f348-4c4d-a88e-80e0ff72d458 req-60d9ed45-c52d-4212-8bbd-ed175af4845a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0848546
May 28 14:22:29.272919 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-60dedccb-f348-4c4d-a88e-80e0ff72d458 req-68026693-07a8-4b82-8743-77fccc3a7fec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402458
May 28 14:22:30.005174 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-cc718a98-923c-4e97-a1dd-ab1534f90e01 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:30.410764 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 57936) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:30.464671 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 req-f3fa303b-bdd4-43c8-9a62-1a6930775922 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:30.466186 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 req-f3fa303b-bdd4-43c8-9a62-1a6930775922 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0850379
May 28 14:22:30.538560 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:30.554007 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:30.558003 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Usage tracker for resource:security_group_rule and tenant:bdd1d0c25f4f48ac8f396b821f15abcf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:30.560992 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:30.567247 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:30.583335 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ab945a46-0043-415d-9d4e-b4cff2d2ad62 req-bee5490c-9a16-4718-9961-cdea911e3b24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1111751
May 28 14:22:30.648899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:30.748130 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:30.755392 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3bb9338b-1828-4529-a1f5-9837e761f73d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:30.800644 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=bdd1d0c25f4f48ac8f396b821f15abcf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3888409
May 28 14:22:30.801535 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c901b9f-1c58-46b0-b046-1bc57d174e1d,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:30.803502 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57944) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:30.804576 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:30.864623 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-61b60686-c0c8-4d47-a4a0-c979b7c0ed29 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:30.889717 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-61b60686-c0c8-4d47-a4a0-c979b7c0ed29 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:31.057052 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-61b60686-c0c8-4d47-a4a0-c979b7c0ed29 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:31.062217 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-09141eb0-8317-4629-b7fc-c1ba26a270bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:31.075199 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61b60686-c0c8-4d47-a4a0-c979b7c0ed29 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c901b9f-1c58-46b0-b046-1bc57d174e1d,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:31.078003 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-61b60686-c0c8-4d47-a4a0-c979b7c0ed29 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:31.078916 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-61b60686-c0c8-4d47-a4a0-c979b7c0ed29 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:31.083243 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-61b60686-c0c8-4d47-a4a0-c979b7c0ed29 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/5c901b9f-1c58-46b0-b046-1bc57d174e1d HTTP/1.1" status: 204  len: 168 time: 0.2786081
May 28 14:22:31.783419 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a643635c-7725-4eb9-94e1-f9b6f622222b req-3e628094-ea70-45e0-bccb-e3c25c4827db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:31.785041 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a643635c-7725-4eb9-94e1-f9b6f622222b req-3e628094-ea70-45e0-bccb-e3c25c4827db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0909722
May 28 14:22:31.818565 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 57976) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:31.837862 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a643635c-7725-4eb9-94e1-f9b6f622222b req-9b8f56c8-b37d-4516-808c-8cf46cc004c3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463233
May 28 14:22:31.839368 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:31.857165 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:31.861153 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Usage tracker for resource:security_group_rule and tenant:d73592720c6146968bb8999c2b65103a is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:31.865107 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:31.871054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:31.954444 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:32.034447 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:32.043928 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-17d41699-2cfd-42f1-93cc-8c94b113318e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:32.088575 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=d73592720c6146968bb8999c2b65103a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2671111
May 28 14:22:32.089498 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f51276c-b510-4a4d-b792-e860ab04c0a7,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:32.092592 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:32.103372 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 57982) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:32.170982 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-90d0263e-f847-48be-a682-eb87231c0b27 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:32.199097 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-90d0263e-f847-48be-a682-eb87231c0b27 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:32.308137 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-90d0263e-f847-48be-a682-eb87231c0b27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:32.312989 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:32.325015 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d0263e-f847-48be-a682-eb87231c0b27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f51276c-b510-4a4d-b792-e860ab04c0a7,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:32.327918 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-90d0263e-f847-48be-a682-eb87231c0b27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:32.329989 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-90d0263e-f847-48be-a682-eb87231c0b27 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:32.330931 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-90d0263e-f847-48be-a682-eb87231c0b27 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/1f51276c-b510-4a4d-b792-e860ab04c0a7 HTTP/1.1" status: 204  len: 168 time: 0.2264731
May 28 14:22:32.897363 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:32.900121 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4d392a72-0af3-44cf-804e-b6ef1170340f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:33.022614 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 req-779df57a-f8cb-458e-8d01-04a1268baab0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:33.024232 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 req-779df57a-f8cb-458e-8d01-04a1268baab0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0809746
May 28 14:22:33.069890 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e71194e2-1487-4a3f-b8b2-0a2e293cb259 req-17ee3f8e-2bc6-43f8-b5d6-9e2b04801d00 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399456
May 28 14:22:33.645196 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:34.258185 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e855b6-5d72-4065-a61e-94fed93c0ff6 req-4bce0262-5b25-4edc-bef1-5b58341d0149 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:34.259651 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-53e855b6-5d72-4065-a61e-94fed93c0ff6 req-4bce0262-5b25-4edc-bef1-5b58341d0149 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0850689
May 28 14:22:34.304303 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-53e855b6-5d72-4065-a61e-94fed93c0ff6 req-a6cbebac-2246-453c-89fe-7bcaeb6f5207 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389876
May 28 14:22:34.540594 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 58048) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:34.546079 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:22:34.658074 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:34.672037 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:34.676148 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Usage tracker for resource:security_group_rule and tenant:c6b5938f4f6642b6b6eb7a572e23ff7c is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:34.678888 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:34.684868 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:34.763623 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:34.822977 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:34.831446 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7e00db70-0da2-40d7-980f-eb2e7f06f5dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:34.875513 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c6b5938f4f6642b6b6eb7a572e23ff7c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3315384
May 28 14:22:34.875513 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ffc9947-0c80-4245-834a-a1e4a41ff464,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:34.876008 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 58058) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:34.878739 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:34.954165 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-828c6d6f-b8bb-4fc1-b46c-dfc37095f953 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:34.979626 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-828c6d6f-b8bb-4fc1-b46c-dfc37095f953 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:35.125155 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-828c6d6f-b8bb-4fc1-b46c-dfc37095f953 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:35.129357 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-29acc628-a947-4fe3-aa4d-474086b1b8c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:35.143472 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828c6d6f-b8bb-4fc1-b46c-dfc37095f953 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ffc9947-0c80-4245-834a-a1e4a41ff464,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:35.147270 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-828c6d6f-b8bb-4fc1-b46c-dfc37095f953 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:35.163011 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-828c6d6f-b8bb-4fc1-b46c-dfc37095f953 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:35.164158 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-828c6d6f-b8bb-4fc1-b46c-dfc37095f953 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/1ffc9947-0c80-4245-834a-a1e4a41ff464 HTTP/1.1" status: 204  len: 168 time: 0.2815773
May 28 14:22:35.291259 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:35.494880 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 req-eb7324fa-2bfa-401a-8c5b-48e655306eb7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:35.496394 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 req-eb7324fa-2bfa-401a-8c5b-48e655306eb7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0849504
May 28 14:22:35.547350 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-962e2a98-1cfa-4ee7-b2ba-2dbce20e72a6 req-19020911-5f87-491b-a040-b378d0e5fa8b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395184
May 28 14:22:36.723700 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 req-ff809e56-062f-4497-b161-a9306723226d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:36.734573 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 req-ff809e56-062f-4497-b161-a9306723226d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0805984
May 28 14:22:36.775393 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8e9c0b03-7fc3-49c6-9d00-8b28efc75ec7 req-c9c44b62-cce2-46ba-b565-3479e4d41336 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442650
May 28 14:22:37.959098 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30875401-0c32-407e-99ab-9f68d8fcf7d8 req-c09b6322-5867-4673-8c1f-a39102329157 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:37.960564 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-30875401-0c32-407e-99ab-9f68d8fcf7d8 req-c09b6322-5867-4673-8c1f-a39102329157 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0790880
May 28 14:22:38.005842 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-30875401-0c32-407e-99ab-9f68d8fcf7d8 req-2fc732bd-3bca-4090-9e11-ddccda856d8f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395417
May 28 14:22:39.202258 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3b9bf6c-06f2-4135-8930-a831489930f7 req-4c0f33b6-695e-4bf4-9dd4-6bc03a011315 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:39.203765 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a3b9bf6c-06f2-4135-8930-a831489930f7 req-4c0f33b6-695e-4bf4-9dd4-6bc03a011315 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0820832
May 28 14:22:39.248109 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a3b9bf6c-06f2-4135-8930-a831489930f7 req-de6fa8c9-c5b4-4803-ac35-99bd98c150f6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387397
May 28 14:22:40.439037 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd09622-65a0-49ae-b733-a4445f446861 req-411dd07b-03a2-4119-8a3c-b76d3cf85307 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:40.440537 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3dd09622-65a0-49ae-b733-a4445f446861 req-411dd07b-03a2-4119-8a3c-b76d3cf85307 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0811419
May 28 14:22:40.499377 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3dd09622-65a0-49ae-b733-a4445f446861 req-2126a9b4-bd4a-4e48-b10b-f9498192b283 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0525022
May 28 14:22:41.099795 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80e56f6-6517-438d-be47-09cbdcccbbcb req-97708a50-4af1-44d3-98a5-b21809797605 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:41.101280 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f80e56f6-6517-438d-be47-09cbdcccbbcb req-97708a50-4af1-44d3-98a5-b21809797605 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0811539
May 28 14:22:41.147854 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f80e56f6-6517-438d-be47-09cbdcccbbcb req-a80f05e0-5ab2-4dcc-9fb9-b88492adefe2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406113
May 28 14:22:41.687799 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4e2883-a043-496d-a82f-353b07532db9 req-c3c0546a-9c83-4f76-a45f-d3f869acbfbb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:41.687799 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8b4e2883-a043-496d-a82f-353b07532db9 req-c3c0546a-9c83-4f76-a45f-d3f869acbfbb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0862894
May 28 14:22:41.732908 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8b4e2883-a043-496d-a82f-353b07532db9 req-eb726cea-e98f-4ed3-88fd-ce143f5d08ae tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397210
May 28 14:22:42.334995 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a req-aa2be9c1-42c9-4542-85f2-e590fd51a629 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:42.336602 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a req-aa2be9c1-42c9-4542-85f2-e590fd51a629 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0811930
May 28 14:22:42.384425 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b021ff4e-fb7d-478c-b0ab-ba034ff8cd9a req-00ee2532-4718-465b-8583-345bc36ce41a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417814
May 28 14:22:42.924144 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc req-f84a0162-5dcf-4b93-83a6-ddbfafdb98f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:42.926262 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc req-f84a0162-5dcf-4b93-83a6-ddbfafdb98f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0860593
May 28 14:22:42.969710 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d3eab3af-abba-4c56-b24e-ae2cd26af5dc req-696e90eb-09bf-4d60-941f-7b4d9a671931 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380311
May 28 14:22:43.589260 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b8f771-2c81-484d-a0b9-69205d537caa req-f2996d8f-0e34-4eb7-828e-b11c5c88f253 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:43.590832 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c1b8f771-2c81-484d-a0b9-69205d537caa req-f2996d8f-0e34-4eb7-828e-b11c5c88f253 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0832810
May 28 14:22:43.639620 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c1b8f771-2c81-484d-a0b9-69205d537caa req-52e2531b-bdc6-4f8a-8625-d8344d249f6c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427577
May 28 14:22:44.151674 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9756595-958f-451a-babd-cb3ddc5a4480 req-a1c40ef3-72dc-4b58-beb8-1bed360e6823 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:44.153034 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f9756595-958f-451a-babd-cb3ddc5a4480 req-a1c40ef3-72dc-4b58-beb8-1bed360e6823 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0799484
May 28 14:22:44.197407 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f9756595-958f-451a-babd-cb3ddc5a4480 req-b408e2c3-2638-4155-bc8e-a4c297520dfb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386999
May 28 14:22:44.836788 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6737d3eb-21d2-425b-b22c-c352cce70cca req-89cd1a29-840e-4795-b29e-8f5d74ebb4c2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:44.838232 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6737d3eb-21d2-425b-b22c-c352cce70cca req-89cd1a29-840e-4795-b29e-8f5d74ebb4c2 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0856748
May 28 14:22:44.887407 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6737d3eb-21d2-425b-b22c-c352cce70cca req-c1263e71-15e2-44ac-aba3-a686f76d4eb6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435090
May 28 14:22:45.386364 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 req-783639aa-dd78-455d-b38f-91032b0ccb37 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:45.387933 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 req-783639aa-dd78-455d-b38f-91032b0ccb37 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0807407
May 28 14:22:45.432985 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ce2ba6e8-8ce2-496f-a82d-6e3020b7a126 req-2c4ba0d9-3adb-42b2-8cba-2ff79add7244 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391707
May 28 14:22:46.078067 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 req-c215fb10-83b9-46ef-95e6-80139d3c0ce3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:46.079418 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 req-c215fb10-83b9-46ef-95e6-80139d3c0ce3 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0855689
May 28 14:22:46.122796 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-828bc7d6-4ccd-4105-9f1f-c1b849ae5859 req-37cb6647-ef8a-40e2-8b67-7d04b60ee493 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377085
May 28 14:22:46.613870 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e05242-8712-4793-be7a-fa921f5bbfbd req-e36eb1ee-42e3-42c9-813d-edf09a4d786a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:46.615619 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-70e05242-8712-4793-be7a-fa921f5bbfbd req-e36eb1ee-42e3-42c9-813d-edf09a4d786a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0783780
May 28 14:22:46.664646 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-70e05242-8712-4793-be7a-fa921f5bbfbd req-25c86c23-fc37-4b48-9dac-d1d28588f822 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421460
May 28 14:22:47.309740 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c req-dd9784c7-40ad-4732-8c60-4d03d4fe33d0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:47.311162 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c req-dd9784c7-40ad-4732-8c60-4d03d4fe33d0 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0790458
May 28 14:22:47.354544 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5fa38ba6-947f-4ef3-a133-fa3efef9d98c req-4370d426-00f7-4d81-9784-e323015ca583 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0372984
May 28 14:22:47.863684 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 req-504c5bf2-9250-4084-bd5e-1bd8f3e381e1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:47.865417 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 req-504c5bf2-9250-4084-bd5e-1bd8f3e381e1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0906606
May 28 14:22:47.911612 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2ec5ac1a-1d56-4a97-8c39-24d9c1afbbd6 req-745a7501-0273-4efe-9703-5213fcf524c0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403593
May 28 14:22:48.544403 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49cb981c-2f58-47f7-adf0-066394fe67f1 req-3088cb29-4f8b-4a55-b190-fcda6912aef6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:48.545890 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-49cb981c-2f58-47f7-adf0-066394fe67f1 req-3088cb29-4f8b-4a55-b190-fcda6912aef6 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0844998
May 28 14:22:48.592018 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-49cb981c-2f58-47f7-adf0-066394fe67f1 req-a73c3cb5-d7bc-4417-8959-76aa8bd85a4f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395389
May 28 14:22:49.122359 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee req-328f5711-3fb1-4839-931a-2eb6ec860122 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:49.123611 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee req-328f5711-3fb1-4839-931a-2eb6ec860122 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0995831
May 28 14:22:49.173569 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6bfbcd2e-0a64-4f09-b0dc-72c713d5dcee req-c5efafd5-e6f6-4224-aa70-d8c3b56bb183 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434141
May 28 14:22:49.786340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 req-e98bd89c-783d-4026-b425-aa5a304a27d8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:49.787821 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 req-e98bd89c-783d-4026-b425-aa5a304a27d8 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0838463
May 28 14:22:49.834250 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-573d54dc-2d24-4bbc-a2b7-782d9b7b3ce0 req-f3a5984d-a763-47d8-8474-eb611e5afc9c tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406392
May 28 14:22:50.176719 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-bec7f9e7-f408-4fa6-9ec7-b9c0862e1368 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:50.178175 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-bec7f9e7-f408-4fa6-9ec7-b9c0862e1368 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.90 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 945 time: 0.0784686
May 28 14:22:50.438764 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 req-4071377f-1a3c-4906-aab6-f88838621e4e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:50.440261 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 req-4071377f-1a3c-4906-aab6-f88838621e4e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1515992
May 28 14:22:50.464269 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Deleting port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:22:50.464638 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:50.569948 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-65d825e4-98f7-4f02-8b31-fd2e2bfd7a57 req-6cdcd1d0-1b9a-4626-8840-fb1d0edfffc3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1233773
May 28 14:22:50.620312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] For port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,segment=NetworkSegment(5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811),segment_id=5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:22:50.620666 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:50.744073 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Calling delete_port for 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:22:50.993699 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:51.000830 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:51.007364 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['6bfc4f29-c29d-4098-8314-02d1e6aa02a9'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:22:51.034902 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1144f41-0ccc-4aeb-908b-722438cab063 req-762c67c3-0806-4722-a1ba-01ef537c4c36 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:51.037169 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f1144f41-0ccc-4aeb-908b-722438cab063 req-762c67c3-0806-4722-a1ba-01ef537c4c36 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 867 time: 0.0887938
May 28 14:22:51.046635 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Pushing event deleted for resources: {'Port': ['ID=6bfc4f29-c29d-4098-8314-02d1e6aa02a9,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:51.051060 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:51.085282 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f1144f41-0ccc-4aeb-908b-722438cab063 req-72afd890-4b31-4abf-8c07-5f39c375ba56 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/security-groups?id=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420027
May 28 14:22:51.135682 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] No DVR routers for this DVR port 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:22:51.138892 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:51.143201 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2da8b01f-1c47-4118-bc09-bffde9f331b7', 'name': 'network-vif-deleted', 'tag': '6bfc4f29-c29d-4098-8314-02d1e6aa02a9'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:22:51.188656 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2da8b01f-1c47-4118-bc09-bffde9f331b7', 'name': 'network-vif-deleted', 'tag': '6bfc4f29-c29d-4098-8314-02d1e6aa02a9', 'status': 'completed', 'code': 200}
May 28 14:22:51.314524 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8a4ef4f6-edd0-4f97-919c-a434d41c35a4 req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.90 "DELETE /v2.0/ports/6bfc4f29-c29d-4098-8314-02d1e6aa02a9 HTTP/1.1" status: 204  len: 173 time: 1.1292109
May 28 14:22:51.766795 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b870abe0-3ea2-4848-be75-59b5e35647e6 req-d6977bfc-eaae-4594-a87e-5d53f3b8f627 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:51.768248 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b870abe0-3ea2-4848-be75-59b5e35647e6 req-d6977bfc-eaae-4594-a87e-5d53f3b8f627 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0879378
May 28 14:22:51.812685 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b870abe0-3ea2-4848-be75-59b5e35647e6 req-4f9c2cca-e26d-49ad-ba8a-4b0fc29285c4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373425
May 28 14:22:52.294102 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-107e7315-e974-4746-b5ae-13a3fc1338e0 req-b060fd55-ade0-48a4-97b1-0515d48a3b21 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0959766
May 28 14:22:52.719454 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 58444) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:52.841600 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:52.856680 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:22:52.860903 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Usage tracker for resource:security_group_rule and tenant:8e874055290a43fbbf425a468de6efa6 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:22:52.864216 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:22:52.870624 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:22:52.953142 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:52.999157 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 req-933bb5ce-8e11-4621-b457-e0d5241eafef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:53.000669 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 req-933bb5ce-8e11-4621-b457-e0d5241eafef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0792074
May 28 14:22:53.033631 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:53.056741 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b5ce1773-b30a-45d8-bc4d-77215dc3d9b4 req-c13deba0-d6b3-480b-a887-7d5d39aa25e3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428090
May 28 14:22:53.057035 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-aa9716e3-9609-4c26-96b3-6962c043177b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:53.096187 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=8e874055290a43fbbf425a468de6efa6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3755491
May 28 14:22:53.098088 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c134cab-5439-481f-bccd-4ec8268c0e3f,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:53.099381 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 58458) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:22:53.101639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:53.164384 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f6a6d860-8a0d-468c-bbd7-63426218878f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:53.188883 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f6a6d860-8a0d-468c-bbd7-63426218878f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:53.400102 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f6a6d860-8a0d-468c-bbd7-63426218878f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:53.405545 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:22:53.419785 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a6d860-8a0d-468c-bbd7-63426218878f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c134cab-5439-481f-bccd-4ec8268c0e3f,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:22:53.422223 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f6a6d860-8a0d-468c-bbd7-63426218878f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:22:53.428546 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f6a6d860-8a0d-468c-bbd7-63426218878f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:53.430178 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-f6a6d860-8a0d-468c-bbd7-63426218878f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/2c134cab-5439-481f-bccd-4ec8268c0e3f HTTP/1.1" status: 204  len: 168 time: 0.3298166
May 28 14:22:53.457337 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-86808b98-20c0-4a7c-88cb-d3993c55fe7a req-0b26bb7b-ec47-4c12-9d5c-1f9114f31150 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Synchronizing usage tracker for tenant:99ce685b86cb47abba407b2e49dcf373 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:22:53.622282 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-86808b98-20c0-4a7c-88cb-d3993c55fe7a req-0b26bb7b-ec47-4c12-9d5c-1f9114f31150 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Unset dirty status for tenant:99ce685b86cb47abba407b2e49dcf373 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:22:53.623576 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-86808b98-20c0-4a7c-88cb-d3993c55fe7a req-0b26bb7b-ec47-4c12-9d5c-1f9114f31150 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.2173395
May 28 14:22:54.240368 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 req-d83266d0-cdae-4954-b8e0-348e81cc452f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:54.241818 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 req-d83266d0-cdae-4954-b8e0-348e81cc452f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0829041
May 28 14:22:54.286901 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-55d0c75d-cf7d-4355-b64e-fbcc34efd145 req-cdef2cb0-1374-4b92-9894-1a5c26d1c3b2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387206
May 28 14:22:54.779412 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd0085-1b9b-4198-89d4-76fde280a668 req-f4f4bd0a-ad07-465b-ba2a-a0def645fb40 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0444469
May 28 14:22:55.481717 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 req-cbffad38-b296-48d2-821d-320345111f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:55.484366 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 req-cbffad38-b296-48d2-821d-320345111f3a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0788431
May 28 14:22:55.531655 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-93a3c6a6-3d2b-4177-90a6-921d7d929b68 req-a1355b73-4aec-4abe-a889-5307e71201db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419276
May 28 14:22:55.930076 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-eefef16e-1974-45cc-9a1a-ab8ac9fecdca req-a4eabf1c-e9c5-4ffa-aebf-1a8620aabe3a tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0455980
May 28 14:22:56.019923 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:22:56.054807 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:22:56.055157 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 6bfc4f29-c29d-4098-8314-02d1e6aa02a9 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:22:56.728595 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6edb950b-6748-400f-8e36-6f329e1e74a8 req-319392e4-617f-4126-8402-eb8aaf092fe1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:56.730281 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6edb950b-6748-400f-8e36-6f329e1e74a8 req-319392e4-617f-4126-8402-eb8aaf092fe1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0803163
May 28 14:22:56.775149 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6edb950b-6748-400f-8e36-6f329e1e74a8 req-deb553a5-2527-4e65-8daa-ced13c0559aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393929
May 28 14:22:57.078912 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f3b757be-1d2b-4959-adeb-e3bbcbf763ca req-a8b6f270-d02e-489f-b2a0-3bd3b1fc5cad tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0447810
May 28 14:22:57.731244 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:22:57.961562 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-843af564-1aa0-40fe-a378-2f0719f262e2 req-10217900-17b5-44c3-8dee-78aff2ee68af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:57.963020 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-843af564-1aa0-40fe-a378-2f0719f262e2 req-10217900-17b5-44c3-8dee-78aff2ee68af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0803375
May 28 14:22:58.009423 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-843af564-1aa0-40fe-a378-2f0719f262e2 req-f63eb53f-2c5d-46c7-8b05-30b8b3978f01 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405757
May 28 14:22:58.231754 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0b998892-35d2-469c-b97d-dae234bce72c req-a8e5b32a-b555-45a8-a41e-8b7334b42b0e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0457234
May 28 14:22:59.258222 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfa716eb-6482-48a8-999e-8754660686ec req-a7ba4ea7-f957-4d55-a266-7b09d85d87ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:22:59.259682 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dfa716eb-6482-48a8-999e-8754660686ec req-a7ba4ea7-f957-4d55-a266-7b09d85d87ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1434505
May 28 14:22:59.306085 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dfa716eb-6482-48a8-999e-8754660686ec req-1b4b7aca-8bca-4571-809d-de551ecdfb4b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394452
May 28 14:22:59.446772 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-67815de1-892f-4aa2-812e-a00af5f6dc53 req-1d39a769-32f8-4a38-998c-008389f32ad4 tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0435314
May 28 14:23:00.044291 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-9ebe61c2-31a1-4c48-a17d-5f523675dc82 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:00.501494 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 req-8436875b-2dd7-4596-901d-92947b0c0eff tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:00.503597 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 req-8436875b-2dd7-4596-901d-92947b0c0eff tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0858428
May 28 14:23:00.547706 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9f4b8aa7-a4dc-417d-8279-365cc749fee4 req-b84f492f-5e31-4a35-b1f7-3a11c447006f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382402
May 28 14:23:00.613126 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5843e9a7-509c-4a96-9cab-7bb19acd1823 req-64173635-a321-4d83-b9ac-b4629037945b tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0425026
May 28 14:23:01.740985 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70237c-b9cb-4841-994c-2c5c58ce4719 req-3a56d406-a4e4-48d7-b790-e8552557dd1a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:01.742678 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bd70237c-b9cb-4841-994c-2c5c58ce4719 req-3a56d406-a4e4-48d7-b790-e8552557dd1a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0849502
May 28 14:23:01.779721 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-74550e30-6945-432b-920c-f0daac9d685d req-e25d0f32-bc63-4705-9b86-cdec5fc6251e tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] 10.222.0.59 "GET /v2.0/ports?device_id=2da8b01f-1c47-4118-bc09-bffde9f331b7 HTTP/1.1" status: 200  len: 210 time: 0.0432253
May 28 14:23:01.792139 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bd70237c-b9cb-4841-994c-2c5c58ce4719 req-aa6f47af-157b-4e67-9838-d93a497fba24 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436246
May 28 14:23:01.970593 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6d40ce-13b9-49e3-9319-44fd05ea43a5 req-15091a39-0e37-4896-a3fe-35f1b82af6a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:01.972645 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fc6d40ce-13b9-49e3-9319-44fd05ea43a5 req-15091a39-0e37-4896-a3fe-35f1b82af6a8 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 1098 time: 0.0690393
May 28 14:23:02.016452 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fc6d40ce-13b9-49e3-9319-44fd05ea43a5 req-cbbb0b15-b27d-4fa8-ba46-15ba9a1da1da service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0359433
May 28 14:23:02.536977 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6910879e-f49f-43a2-a0e1-8577deb7a1f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:02.539787 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:02.996351 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd63bf28-dd63-4191-89ab-eb82b1553c66 req-0db20493-48d5-4bad-aee6-d92d88221c86 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:03.003255 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bd63bf28-dd63-4191-89ab-eb82b1553c66 req-0db20493-48d5-4bad-aee6-d92d88221c86 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0885706
May 28 14:23:03.047235 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bd63bf28-dd63-4191-89ab-eb82b1553c66 req-71b78989-6f89-47e6-a061-250f543b42b1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425122
May 28 14:23:03.857079 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:04.233313 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b req-1b97ff56-23b6-4a26-86aa-b1fc41deec48 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:04.234819 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b req-1b97ff56-23b6-4a26-86aa-b1fc41deec48 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0784693
May 28 14:23:04.279169 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c5a33b10-9f2c-42c4-bacf-142a5fdc766b req-871f6548-1dec-44dd-8198-c6b5d5afa7d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0376415
May 28 14:23:04.493233 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f6928b-3528-4ff1-aded-5924e1222011 req-cbb114dd-f318-4061-a23c-14335c24e3d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:04.494779 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f4f6928b-3528-4ff1-aded-5924e1222011 req-cbb114dd-f318-4061-a23c-14335c24e3d0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1014173
May 28 14:23:04.543529 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f4f6928b-3528-4ff1-aded-5924e1222011 req-a9cf166d-2c1e-4f4f-9e56-827c97d97853 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418468
May 28 14:23:05.065526 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 58718) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:05.187257 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:05.201587 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:05.205373 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Usage tracker for resource:security_group_rule and tenant:6d3f164e18d94fb3bd28337c76b2aac0 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:05.208768 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:05.214428 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:05.296524 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:05.359461 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:05.410784 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:05.420837 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-19700020-3ad1-43b1-abcc-69996c905b94 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:05.458585 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34a57764-0a60-43bf-87c5-2d7ec8fe12e5,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:05.462998 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=6d3f164e18d94fb3bd28337c76b2aac0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3964040
May 28 14:23:05.463870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:05.465697 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 58726) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:05.528017 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-20f12716-2fdf-4d04-9408-2f9245757df5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:05.558713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-20f12716-2fdf-4d04-9408-2f9245757df5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:05.765170 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-20f12716-2fdf-4d04-9408-2f9245757df5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:05.770538 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9a28892f-1c0c-4a41-b9d7-f3b56fb8cbb1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:05.785369 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f12716-2fdf-4d04-9408-2f9245757df5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34a57764-0a60-43bf-87c5-2d7ec8fe12e5,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:05.787728 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-20f12716-2fdf-4d04-9408-2f9245757df5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:05.794189 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-20f12716-2fdf-4d04-9408-2f9245757df5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:05.808345 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-20f12716-2fdf-4d04-9408-2f9245757df5 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/34a57764-0a60-43bf-87c5-2d7ec8fe12e5 HTTP/1.1" status: 204  len: 168 time: 0.3313482
May 28 14:23:06.589991 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 58750) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:06.611769 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:06.627112 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:06.631635 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Usage tracker for resource:security_group_rule and tenant:257f4d51f72a4592bbee2891f1ce04fc is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:06.634418 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:06.644238 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:06.723267 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:06.856993 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:06.866273 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-80906b1e-aa43-41dd-8c26-4aaa72a5a790 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:06.905122 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=257f4d51f72a4592bbee2891f1ce04fc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3140550
May 28 14:23:06.907887 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 58762) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:06.911278 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9dcc969b-330c-4c6a-9876-fd3a62d542eb,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:06.922348 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:06.970702 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eb63adaf-9c77-411e-a3c8-1bb81089d61b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:06.998466 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eb63adaf-9c77-411e-a3c8-1bb81089d61b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:07.164807 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eb63adaf-9c77-411e-a3c8-1bb81089d61b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:07.169967 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:07.186782 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb63adaf-9c77-411e-a3c8-1bb81089d61b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9dcc969b-330c-4c6a-9876-fd3a62d542eb,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:07.189551 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eb63adaf-9c77-411e-a3c8-1bb81089d61b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:07.190436 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eb63adaf-9c77-411e-a3c8-1bb81089d61b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:07.191607 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-eb63adaf-9c77-411e-a3c8-1bb81089d61b admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/9dcc969b-330c-4c6a-9876-fd3a62d542eb HTTP/1.1" status: 204  len: 168 time: 0.2828176
May 28 14:23:11.545146 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:23:20.639726 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 req-49098591-7e77-48de-bbc3-936375385091 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:20.641182 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 req-49098591-7e77-48de-bbc3-936375385091 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0812266
May 28 14:23:20.662985 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-0c3a742c-f21b-4682-ab5a-37a0ac755454 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:20.664434 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-0c3a742c-f21b-4682-ab5a-37a0ac755454 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1098 time: 0.0747712
May 28 14:23:20.686930 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-eaefc2a8-91e7-4c60-9d73-54fbc0008f81 req-ebfc5ae0-2bb9-4c11-96c4-74a926ef92be tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394535
May 28 14:23:20.828359 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-0441ddbc-b436-42a2-b294-7924f7b4dc0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:20.829862 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-0441ddbc-b436-42a2-b294-7924f7b4dc0a service neutron] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 920 time: 0.1493678
May 28 14:23:20.905194 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-783f3f7a-ace1-49f2-920f-04abf0e81149 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84 HTTP/1.1" status: 200  len: 217 time: 0.0650227
May 28 14:23:20.972491 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-078d6454-437b-40bd-acef-7c8c0ab3b571 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:20.975372 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-078d6454-437b-40bd-acef-7c8c0ab3b571 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0601671
May 28 14:23:21.027265 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-1645ca4e-0122-4c32-891d-3487f4b16bc9 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0424991
May 28 14:23:21.177063 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-18add587-5604-4d67-a482-fec5cebbc57f service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1326849
May 28 14:23:21.320857 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6775e4fa-9c3c-49c2-bdb1-b81d8d388e2a req-9528dfaf-8c70-4618-9079-9172f6c4a82a service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1327059
May 28 14:23:21.617721 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59124) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:21.682911 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Deleting subnet c8e92692-f94e-42ef-9b0b-7db259ad1468 {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:23:21.685845 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:21.737056 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1610776'] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:21.940784 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:22.022942 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-402d47b4-a99e-455c-891e-d0b970eb8f6e req-4c10eb73-f1ea-4dcf-94ad-1db5a6a14cca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:22.024415 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-402d47b4-a99e-455c-891e-d0b970eb8f6e req-4c10eb73-f1ea-4dcf-94ad-1db5a6a14cca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1582253
May 28 14:23:22.150060 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-402d47b4-a99e-455c-891e-d0b970eb8f6e req-112daccf-6be9-4b31-b4e2-d27a6574fa77 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1131687
May 28 14:23:22.336593 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1635750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1808149'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:22.341571 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:22.381146 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c8e92692-f94e-42ef-9b0b-7db259ad1468,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:22.384120 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:22.393517 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/c8e92692-f94e-42ef-9b0b-7db259ad1468 HTTP/1.1" status: 204  len: 168 time: 0.7747185
May 28 14:23:22.395058 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.395419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.395895 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.396241 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.396359 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59156) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:22.396805 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.396908 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.397238 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.397576 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.397976 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.398323 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.398654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.398988 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:22.402007 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:22.510503 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:22.629271 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:22.645716 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fbba22f7b20>> segment before_delete 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.646055 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fbba22f7b20>> subnet precommit_delete_associations 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.646789 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba0e909d0>> segment_host_mapping after_create 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.647155 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba0e909d0>> port after_create 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.647480 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba0e909d0>> port after_delete 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.647856 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba0e909d0>> port after_update 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.648175 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba0e909d0>> segment after_delete 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.648492 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba0e909d0>> subnet after_create 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.648805 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba0e909d0>> subnet after_delete 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.649123 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fbba0e909d0>> subnet after_update 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.792184 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fbba0f17b50>> subnet after_create 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.792543 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fbba0f17b50>> subnet after_delete 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.792877 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fbba0f17b50>> subnet before_create 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.793213 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fbba0f17b50>> subnet before_update 55550000 {{(pid=92694) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 28 14:23:22.793576 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba22f7f10>,) {'filters': {'network_id': ['91ebc16a-e9fa-40de-8d8f-6fe4965dc314']}} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:23:22.806759 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba22f7f10>, '5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811') {'for_net_delete': True} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:23:22.807829 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba22f7f10>, '5cc9be5e-6f6d-41a4-9d18-fcbdf85ab811') {} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:23:22.820261 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1655015'] for segment, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:22.836946 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:22.843871 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Releasing vlan 887 on physical network physnet1 to pool {{(pid=92694) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:23:22.844196 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3422942'] for segment, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   from cryptography.utils import int_from_bytes
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   from cryptography.utils import int_from_bytes
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]: Traceback (most recent call last):
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     timer()
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     cb(*args, **kw)
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     return func(*args, **kwargs)
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     self._notify()
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     self.callback(batched_events)
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     event.method(event)
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     return f(self, *a, **k)
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._get(url).json()
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self.request(url, 'GET', **kwargs)
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:23:22.859409 dv-cinder-791281-3-iscsi neutron-server[92694]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:23:23.016706 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.021088 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:23.037097 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.045222 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Pushing event deleted for resources: {'Network': ['ID=91ebc16a-e9fa-40de-8d8f-6fe4965dc314,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:23.056304 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.059828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.060638 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:23:23.062890 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:23.149050 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] 10.222.0.59 "DELETE /v2.0/networks/91ebc16a-e9fa-40de-8d8f-6fe4965dc314 HTTP/1.1" status: 204  len: 168 time: 0.7514822
May 28 14:23:23.229695 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59184) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:23.355216 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e7fc59-834a-4108-bf0b-a849ff75d471 req-f50039ac-42b4-41ac-a11c-a723883295a5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:23.356694 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6e7fc59-834a-4108-bf0b-a849ff75d471 req-f50039ac-42b4-41ac-a11c-a723883295a5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0826364
May 28 14:23:23.362677 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.378952 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:23.382716 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Usage tracker for resource:security_group_rule and tenant:cc6a904554fd4f93a4d81bdfffe0de34 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:23.385510 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:23.391134 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:23.402961 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6e7fc59-834a-4108-bf0b-a849ff75d471 req-b4621c2c-6945-420f-816e-cb69b895c05a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398645
May 28 14:23:23.475055 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.548031 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.558068 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:23.583482 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59192) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:23.598539 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=cc6a904554fd4f93a4d81bdfffe0de34&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3677044
May 28 14:23:23.601373 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59196) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:23.604522 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1a7ca0e-f8dc-48d6-b5b1-91089cbfcc0b,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:23.607901 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:23.674927 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-ee10818e-99d0-449c-acee-85e80a4e1039 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=99ce685b86cb47abba407b2e49dcf373&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0896637
May 28 14:23:23.676945 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59200) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:23.711203 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3b55403-df44-4003-9365-e5c44cbab385 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.753937 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3b55403-df44-4003-9365-e5c44cbab385 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.786075 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ae821cce-1111-4fcf-8bde-c17c275e0312 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.825947 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ae821cce-1111-4fcf-8bde-c17c275e0312 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.936559 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3b55403-df44-4003-9365-e5c44cbab385 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.941545 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:23.954597 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3b55403-df44-4003-9365-e5c44cbab385 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1a7ca0e-f8dc-48d6-b5b1-91089cbfcc0b,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:23.959087 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c3b55403-df44-4003-9365-e5c44cbab385 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:23.976058 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ae821cce-1111-4fcf-8bde-c17c275e0312 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:23.994672 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b4a7b211-de51-46a9-8400-697c0e974666 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:23.996732 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae821cce-1111-4fcf-8bde-c17c275e0312 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:23.998820 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ae821cce-1111-4fcf-8bde-c17c275e0312 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:24.000887 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-ae821cce-1111-4fcf-8bde-c17c275e0312 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/0b83b555-c9d5-4d30-8c0c-af9af6c8a9ed HTTP/1.1" status: 204  len: 168 time: 0.3219910
May 28 14:23:24.000887 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ae821cce-1111-4fcf-8bde-c17c275e0312 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:24.051180 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3b55403-df44-4003-9365-e5c44cbab385 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:24.054740 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c3b55403-df44-4003-9365-e5c44cbab385 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b1a7ca0e-f8dc-48d6-b5b1-91089cbfcc0b HTTP/1.1" status: 204  len: 168 time: 0.4486532
May 28 14:23:24.597362 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251752ab-bfee-481a-9a0e-7b44892db825 req-991406a7-5572-4b07-b4d6-e6b5c89687b2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:24.598879 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-251752ab-bfee-481a-9a0e-7b44892db825 req-991406a7-5572-4b07-b4d6-e6b5c89687b2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0812600
May 28 14:23:24.643361 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-251752ab-bfee-481a-9a0e-7b44892db825 req-a01ea63b-ade0-426a-a4d4-fded517f9fce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384004
May 28 14:23:24.858215 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59230) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:24.876725 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:24.891401 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:24.898165 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Usage tracker for resource:security_group_rule and tenant:41bb93f6bf4c4ccc94d6ef5839941a0e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:24.901065 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:24.906791 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:24.993977 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:25.073537 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:25.082135 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-bcd7d7b3-1ca0-465d-8de2-b5af3b08f935 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:25.122318 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=41bb93f6bf4c4ccc94d6ef5839941a0e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2630379
May 28 14:23:25.123992 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7114aa2b-780a-4117-9339-e1f44a73686d,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:25.125011 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59242) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:25.127117 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:25.200699 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-934723b6-29b9-4d5f-b176-1eac5b0a6297 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:25.227223 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-934723b6-29b9-4d5f-b176-1eac5b0a6297 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:25.347861 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-934723b6-29b9-4d5f-b176-1eac5b0a6297 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:25.351751 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-80a9d6cb-8c75-4b79-b868-fef07ddb7882 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:25.362731 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-934723b6-29b9-4d5f-b176-1eac5b0a6297 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7114aa2b-780a-4117-9339-e1f44a73686d,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:25.367862 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-934723b6-29b9-4d5f-b176-1eac5b0a6297 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:25.369767 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-934723b6-29b9-4d5f-b176-1eac5b0a6297 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:25.371370 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-934723b6-29b9-4d5f-b176-1eac5b0a6297 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7114aa2b-780a-4117-9339-e1f44a73686d HTTP/1.1" status: 204  len: 168 time: 0.2448418
May 28 14:23:25.854331 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b173d0aa-f90a-49ff-8014-3ed9a3033046 req-0f63117a-e0e5-4775-ac20-b02ae020af15 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:25.855795 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b173d0aa-f90a-49ff-8014-3ed9a3033046 req-0f63117a-e0e5-4775-ac20-b02ae020af15 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0920467
May 28 14:23:25.904627 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b173d0aa-f90a-49ff-8014-3ed9a3033046 req-5ca6388f-d339-4339-aca6-8e7f15b97908 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431199
May 28 14:23:26.166930 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59296) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:26.288086 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:26.302764 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:26.306658 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Usage tracker for resource:security_group_rule and tenant:ea79a35fe99842f582b2eea56aa401b3 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:26.309510 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:26.316155 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:26.406907 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:26.502457 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:26.538168 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-20f12716-2fdf-4d04-9408-2f9245757df5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:26.574622 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ea79a35fe99842f582b2eea56aa401b3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4065583
May 28 14:23:26.577715 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59320) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:26.584327 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1141a086-dd58-4a9d-bb16-38fa696b806a,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:26.589450 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:26.649892 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bdfde01e-a6f2-481e-81ad-8cc96b3b2503 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:26.676697 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bdfde01e-a6f2-481e-81ad-8cc96b3b2503 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:26.690916 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-e617a00b-14c0-451b-ae0f-9e19874b53c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:26.692467 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-e617a00b-14c0-451b-ae0f-9e19874b53c8 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1098 time: 0.0791371
May 28 14:23:26.811229 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bdfde01e-a6f2-481e-81ad-8cc96b3b2503 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:26.818685 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-22d28ab9-8a0c-41d2-9bdd-d3b1d23cf405 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:26.838172 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdfde01e-a6f2-481e-81ad-8cc96b3b2503 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1141a086-dd58-4a9d-bb16-38fa696b806a,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:26.842620 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-bdfde01e-a6f2-481e-81ad-8cc96b3b2503 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:26.866129 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-c6af4354-fbde-4a83-95ae-e7e0226a2cf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:26.867009 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-c6af4354-fbde-4a83-95ae-e7e0226a2cf6 service neutron] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 920 time: 0.1405504
May 28 14:23:26.871247 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bdfde01e-a6f2-481e-81ad-8cc96b3b2503 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:26.872352 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-bdfde01e-a6f2-481e-81ad-8cc96b3b2503 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/1141a086-dd58-4a9d-bb16-38fa696b806a HTTP/1.1" status: 204  len: 168 time: 0.2930334
May 28 14:23:26.942940 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-5460f20d-a37c-415c-a225-aa8fc121d5a2 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84 HTTP/1.1" status: 200  len: 217 time: 0.0667331
May 28 14:23:27.009179 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-481a4d6c-f8f9-4a28-b56e-7b39e284c9a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:27.010613 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-481a4d6c-f8f9-4a28-b56e-7b39e284c9a8 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0590124
May 28 14:23:27.100775 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-dab96cf0-bf55-44d4-81d8-e5375ad24e63 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0452783
May 28 14:23:27.329296 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb req-2b0444b4-85fd-413d-b42b-7d75055afad2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:27.331347 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb req-2b0444b4-85fd-413d-b42b-7d75055afad2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.3150992
May 28 14:23:27.364522 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-8c9ef61c-be8f-44dd-87c9-03cac1b0fffb service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2554228
May 28 14:23:27.460346 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7958fe1a-09aa-4ec9-b6b2-ef6bb38b04bb req-6c427d50-524f-4e17-a7e8-1c99f02f3162 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1194212
May 28 14:23:27.522192 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2d436f78-a355-491b-b6d0-af5764e7d0b8 req-f4893bfe-6cc8-4e18-9da9-fbae18832b3b service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1430497
May 28 14:23:27.759334 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:28.667249 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac57f22-a979-4ef8-9ade-1d223142159f req-59dfbf53-d297-447c-868a-714f4ee3e164 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:28.670970 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4ac57f22-a979-4ef8-9ade-1d223142159f req-59dfbf53-d297-447c-868a-714f4ee3e164 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0995588
May 28 14:23:28.718363 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4ac57f22-a979-4ef8-9ade-1d223142159f req-fa647570-f764-40bb-b85f-6dc982f89b09 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406039
May 28 14:23:29.913877 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 req-2acedaf5-6b1e-439d-ab12-1bfd6dc7d38e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:29.916114 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 req-2acedaf5-6b1e-439d-ab12-1bfd6dc7d38e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0850298
May 28 14:23:29.998382 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-62e17c4a-7668-489c-ae67-2d31ecf5ce74 req-9a18c828-13d3-4c06-ac48-3e06c819a60e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0531552
May 28 14:23:30.079202 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f1bfbc62-4580-4139-a48f-b8d10cd9478b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:30.741271 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59468) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:30.870245 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:30.886334 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:30.890369 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Usage tracker for resource:security_group_rule and tenant:82dced9273bb4dbebe58617f1937b383 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:30.893351 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:30.899018 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:30.981448 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:31.085179 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:31.094377 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-90d0263e-f847-48be-a682-eb87231c0b27 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:31.138789 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=82dced9273bb4dbebe58617f1937b383&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3964388
May 28 14:23:31.140423 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59486) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:31.150975 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f64e8525-b86e-4eb2-9744-8f4dfed6dded,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:31.158365 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:31.213274 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-abae7551-a4a2-4069-9b5b-d0f183f34dc4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:31.252940 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de54a2a4-9d89-4978-ac59-3e3da2040a36 req-9c6056b6-d9c3-4578-9522-b40d9ee59d0d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:31.255893 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-de54a2a4-9d89-4978-ac59-3e3da2040a36 req-9c6056b6-d9c3-4578-9522-b40d9ee59d0d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1417587
May 28 14:23:31.287954 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-abae7551-a4a2-4069-9b5b-d0f183f34dc4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:31.362895 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-de54a2a4-9d89-4978-ac59-3e3da2040a36 req-7727275c-6e38-4d98-b52e-809df30fa9d7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0973003
May 28 14:23:31.444686 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-abae7551-a4a2-4069-9b5b-d0f183f34dc4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:31.458367 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8516d70e-2728-4dad-aea9-112ee36f9f93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:31.537738 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abae7551-a4a2-4069-9b5b-d0f183f34dc4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f64e8525-b86e-4eb2-9744-8f4dfed6dded,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:31.541189 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-abae7551-a4a2-4069-9b5b-d0f183f34dc4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:31.544754 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-abae7551-a4a2-4069-9b5b-d0f183f34dc4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:31.556510 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-abae7551-a4a2-4069-9b5b-d0f183f34dc4 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/f64e8525-b86e-4eb2-9744-8f4dfed6dded HTTP/1.1" status: 204  len: 168 time: 0.4148715
May 28 14:23:31.762986 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59512) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:31.954433 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:31.970892 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:31.974699 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Usage tracker for resource:security_group_rule and tenant:c2ce2871b20b4b8d9e17e9028f8629b6 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:31.977589 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:31.983217 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:32.075500 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.191055 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.199806 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e6d6d2a8-dfaf-4e47-8227-18f466c789ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:32.246184 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c2ce2871b20b4b8d9e17e9028f8629b6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4819391
May 28 14:23:32.247803 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a8402c2-6cb0-41db-9488-2901c52be9c1,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:32.248803 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59526) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:32.257230 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:32.312386 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-204b1730-17f0-4c21-be45-0228920862e9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.348712 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-204b1730-17f0-4c21-be45-0228920862e9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.352444 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59534) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:32.381758 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.408481 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:32.414901 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Usage tracker for resource:security_group_rule and tenant:ebbb727c35224ba8a064a83386a8d5be is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:32.418836 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:32.429477 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:32.513309 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.546879 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b3d79c1a-b26b-4645-b842-deddedb96a0a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.549910 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-204b1730-17f0-4c21-be45-0228920862e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.561446 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c1f503ea-679a-494a-8359-a297a49f2562 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:32.577743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-204b1730-17f0-4c21-be45-0228920862e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a8402c2-6cb0-41db-9488-2901c52be9c1,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:32.596537 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-204b1730-17f0-4c21-be45-0228920862e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:32.597498 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-204b1730-17f0-4c21-be45-0228920862e9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.602996 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-204b1730-17f0-4c21-be45-0228920862e9 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/0a8402c2-6cb0-41db-9488-2901c52be9c1 HTTP/1.1" status: 204  len: 168 time: 0.3525307
May 28 14:23:32.634975 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.654258 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-110ac468-4928-44bb-a903-0a5e206df72e req-9350c9bd-e1e4-4477-a20e-bdd28c1fb453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:32.660086 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-110ac468-4928-44bb-a903-0a5e206df72e req-9350c9bd-e1e4-4477-a20e-bdd28c1fb453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1474545
May 28 14:23:32.718842 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-110ac468-4928-44bb-a903-0a5e206df72e req-f277a2e4-ef7e-494c-850e-33c6f2037a9e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435967
May 28 14:23:32.742026 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.750949 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d3fec155-f40b-4b2a-91d5-bfc9e2e50145 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:32.791865 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ebbb727c35224ba8a064a83386a8d5be&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4383256
May 28 14:23:32.792746 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=35c215de-277e-402e-978e-2a027f42d297,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:32.794589 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59550) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:32.795813 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:32.856288 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c9b60555-2d36-448d-b3eb-0a40946d4879 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:32.882187 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c9b60555-2d36-448d-b3eb-0a40946d4879 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:33.039289 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c9b60555-2d36-448d-b3eb-0a40946d4879 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:33.043033 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:33.054595 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b60555-2d36-448d-b3eb-0a40946d4879 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35c215de-277e-402e-978e-2a027f42d297,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:33.058043 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c9b60555-2d36-448d-b3eb-0a40946d4879 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:33.061990 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c9b60555-2d36-448d-b3eb-0a40946d4879 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:33.063094 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c9b60555-2d36-448d-b3eb-0a40946d4879 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/35c215de-277e-402e-978e-2a027f42d297 HTTP/1.1" status: 204  len: 168 time: 0.2675166
May 28 14:23:33.550055 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59566) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:33.570360 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:33.607804 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:33.617803 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Usage tracker for resource:security_group_rule and tenant:34566211a2fe47bf94d226f8b370366e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:33.622674 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:33.630118 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:33.726163 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:33.730186 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:33.772951 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59584) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:33.835141 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:33.846009 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-153df3b1-a574-46d6-9959-a860b56d6d40 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:33.869024 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-feb047ca-7525-4488-a7b7-fc0e96496bd8 admin admin] Deleting subnet 58490f39-86f2-45b0-85f6-38ca44011b6a {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:23:33.919080 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-feb047ca-7525-4488-a7b7-fc0e96496bd8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:33.989337 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=34566211a2fe47bf94d226f8b370366e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4379902
May 28 14:23:33.992386 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59598) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:33.993341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b98bd1ab-fed7-4c1a-8739-312c1bc42b06,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:33.996442 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:34.012612 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-feb047ca-7525-4488-a7b7-fc0e96496bd8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1610776'] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.077664 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-57d7c155-453d-4ff6-839e-5386f0d49772 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.091882 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 req-db80b822-ff4c-490d-9f47-55cdb296511f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:34.093470 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 req-db80b822-ff4c-490d-9f47-55cdb296511f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.2335868
May 28 14:23:34.094594 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-feb047ca-7525-4488-a7b7-fc0e96496bd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.108674 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-57d7c155-453d-4ff6-839e-5386f0d49772 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.206955 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-20938ae6-5204-431e-bbc4-58f2d54ecbc4 req-b98c3266-0614-4ca5-9229-60b706fb3265 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0823915
May 28 14:23:34.319351 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-57d7c155-453d-4ff6-839e-5386f0d49772 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.323428 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:34.342563 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d7c155-453d-4ff6-839e-5386f0d49772 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b98bd1ab-fed7-4c1a-8739-312c1bc42b06,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:34.345147 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-57d7c155-453d-4ff6-839e-5386f0d49772 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:34.368959 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-57d7c155-453d-4ff6-839e-5386f0d49772 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.370211 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-57d7c155-453d-4ff6-839e-5386f0d49772 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b98bd1ab-fed7-4c1a-8739-312c1bc42b06 HTTP/1.1" status: 204  len: 168 time: 0.3768406
May 28 14:23:34.491474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-feb047ca-7525-4488-a7b7-fc0e96496bd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1635750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1808149'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.497376 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:34.532142 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feb047ca-7525-4488-a7b7-fc0e96496bd8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=58490f39-86f2-45b0-85f6-38ca44011b6a,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:34.535841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-feb047ca-7525-4488-a7b7-fc0e96496bd8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:34.536824 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-feb047ca-7525-4488-a7b7-fc0e96496bd8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.549630 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-feb047ca-7525-4488-a7b7-fc0e96496bd8 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/58490f39-86f2-45b0-85f6-38ca44011b6a HTTP/1.1" status: 204  len: 168 time: 0.7731497
May 28 14:23:34.549963 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59612) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:34.674935 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.879131 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.901760 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba1422130>,) {'filters': {'network_id': ['6b02addc-afca-4b17-a9ca-45bef6a29ad9']}} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:23:34.916899 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba1422130>, '877899c7-fd92-41e8-8048-ed89094c1e44') {'for_net_delete': True} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:23:34.917202 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba1422130>, '877899c7-fd92-41e8-8048-ed89094c1e44') {} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:23:34.932596 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1655015'] for segment, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.953102 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.964775 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Releasing vlan 872 on physical network physnet1 to pool {{(pid=92694) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:23:34.965220 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3422942'] for segment, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]: Traceback (most recent call last):
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     timer()
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     cb(*args, **kw)
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     return func(*args, **kwargs)
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     self._notify()
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     self.callback(batched_events)
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     event.method(event)
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     return f(self, *a, **k)
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._get(url).json()
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self.request(url, 'GET', **kwargs)
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:23:34.983899 dv-cinder-791281-3-iscsi neutron-server[92694]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:23:35.291034 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:35.294887 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ceb8f94d-8791-4672-a27a-9897588ad1e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:35.317328 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:35.320143 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Pushing event deleted for resources: {'Network': ['ID=6b02addc-afca-4b17-a9ca-45bef6a29ad9,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:35.323064 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:35.331893 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] 10.222.0.59 "DELETE /v2.0/networks/6b02addc-afca-4b17-a9ca-45bef6a29ad9 HTTP/1.1" status: 204  len: 168 time: 0.7757852
May 28 14:23:35.336143 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59646) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:35.359891 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:35.409965 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_v2 [None req-de420757-a8cf-4694-8bf1-1e294f4e6c33 admin admin] Deleting subnet ed0bc661-c04b-4e27-a52d-de9a2196d209 {{(pid=92694) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:23:35.414193 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-de420757-a8cf-4694-8bf1-1e294f4e6c33 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:35.420652 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-852ff1dd-7dae-4182-8e70-86bd354927a7 req-ad8f7b92-1bac-47a6-af81-9f1d08438c4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:35.430785 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-852ff1dd-7dae-4182-8e70-86bd354927a7 req-ad8f7b92-1bac-47a6-af81-9f1d08438c4a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1124053
May 28 14:23:35.475520 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-852ff1dd-7dae-4182-8e70-86bd354927a7 req-ec6bf2c2-201e-4991-9e93-c76872bc47ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438700
May 28 14:23:35.486929 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-de420757-a8cf-4694-8bf1-1e294f4e6c33 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1655020'] for subnet, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:35.555631 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-de420757-a8cf-4694-8bf1-1e294f4e6c33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:35.999627 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-de420757-a8cf-4694-8bf1-1e294f4e6c33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3483512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3521832'] for subnet, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:36.005545 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5b655859-6804-48e3-89f4-76ab2499673c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:36.048936 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de420757-a8cf-4694-8bf1-1e294f4e6c33 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ed0bc661-c04b-4e27-a52d-de9a2196d209,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:36.049679 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-de420757-a8cf-4694-8bf1-1e294f4e6c33 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:36.054574 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-de420757-a8cf-4694-8bf1-1e294f4e6c33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:36.059468 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-de420757-a8cf-4694-8bf1-1e294f4e6c33 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/ed0bc661-c04b-4e27-a52d-de9a2196d209 HTTP/1.1" status: 204  len: 168 time: 0.7224419
May 28 14:23:36.059753 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59690) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:36.166317 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:36.304056 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:36.316644 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba0f4e940>,) {'filters': {'network_id': ['03a86622-6f07-4ee2-8cbf-d4df121dfb51']}} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:23:36.328300 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0f4e940>, '526589c8-79eb-41ed-aa41-773f51b38e74') {'for_net_delete': True} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:23:36.328615 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0f4e940>, '526589c8-79eb-41ed-aa41-773f51b38e74') {} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:23:36.339633 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1655015'] for segment, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:36.356371 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:36.363066 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Releasing vlan 860 on physical network physnet1 to pool {{(pid=92694) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:23:36.365053 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3422942'] for segment, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]: Traceback (most recent call last):
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     timer()
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     cb(*args, **kw)
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     return func(*args, **kwargs)
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     self._notify()
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     self.callback(batched_events)
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     event.method(event)
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     return f(self, *a, **k)
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._get(url).json()
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self.request(url, 'GET', **kwargs)
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:23:36.377500 dv-cinder-791281-3-iscsi neutron-server[92694]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:23:36.632566 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:36.632566 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-12ece11e-5e51-4e0b-b766-37bc976cd64e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:36.649163 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:36.656913 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Pushing event deleted for resources: {'Network': ['ID=03a86622-6f07-4ee2-8cbf-d4df121dfb51,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:36.660714 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:36.668691 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-87516c7d-f5ab-4c3b-9d1c-1268ee5bf5ba admin admin] 10.222.0.59 "DELETE /v2.0/networks/03a86622-6f07-4ee2-8cbf-d4df121dfb51 HTTP/1.1" status: 204  len: 168 time: 0.6021459
May 28 14:23:36.706987 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 req-7a646614-f4f8-4219-a405-b504b1d8eb70 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:36.709362 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 req-7a646614-f4f8-4219-a405-b504b1d8eb70 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1029584
May 28 14:23:36.792246 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6a2b5b24-1960-4cf4-87e6-aeecaf1567c8 req-7f4120c4-af9b-4cc8-a81c-82f0437bbf60 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0761728
May 28 14:23:37.232513 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59754) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:37.282617 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-1debfdfa-848c-4dc8-83b5-e15a86a40c39 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=f850196b4c014b48b9dd79a436895e8a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0487642
May 28 14:23:37.285411 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59758) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:37.351258 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904d8d3f-8350-4205-bea5-693c80f446fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:37.380061 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904d8d3f-8350-4205-bea5-693c80f446fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:37.512989 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904d8d3f-8350-4205-bea5-693c80f446fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:37.518580 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-20e79778-4d94-460b-9a6b-6e34f0168e06 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:37.536441 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904d8d3f-8350-4205-bea5-693c80f446fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58726f5c-17e6-4114-8f7d-22d900bb7a12,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:37.536441 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-904d8d3f-8350-4205-bea5-693c80f446fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:37.536441 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904d8d3f-8350-4205-bea5-693c80f446fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:37.536928 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-904d8d3f-8350-4205-bea5-693c80f446fd admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/58726f5c-17e6-4114-8f7d-22d900bb7a12 HTTP/1.1" status: 204  len: 168 time: 0.2495263
May 28 14:23:37.993149 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59776) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:38.091987 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 req-16ed4974-df96-4fef-b4f8-f8b5b52eb698 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:38.093620 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 req-16ed4974-df96-4fef-b4f8-f8b5b52eb698 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.2114530
May 28 14:23:38.145098 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-96711892-d2f0-4fbd-be9b-b7ab3412beb4 req-15990464-63f6-482b-98f1-f96cac56c621 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451729
May 28 14:23:38.165318 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.180342 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:38.184171 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Usage tracker for resource:security_group_rule and tenant:24fdcfbc9289498498391db9fc2a4da1 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:38.187150 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:38.192869 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:38.279007 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.359186 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.368684 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:38.409910 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=24fdcfbc9289498498391db9fc2a4da1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4156873
May 28 14:23:38.411482 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a87ac0a-fd98-48dd-b801-371c0bb9f0e6,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:38.412589 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59788) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:38.414426 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:38.464666 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59792) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:38.477089 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fd266fda-74d9-4512-ac25-67ddcfa8e8fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.505713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fd266fda-74d9-4512-ac25-67ddcfa8e8fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.525595 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-84cbbf3b-a8b9-4391-8d3a-74c4432977b4 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a1a272a6daf142fca2c547421c2e35f9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0598783
May 28 14:23:38.528133 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59796) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:38.591345 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1c53938e-e7ad-45d4-b888-68a26f60d8fb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.618298 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1c53938e-e7ad-45d4-b888-68a26f60d8fb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.627765 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fd266fda-74d9-4512-ac25-67ddcfa8e8fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.632714 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5f6f9beb-a6a3-4cd3-a0cb-74f61c6e3115 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:38.645987 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd266fda-74d9-4512-ac25-67ddcfa8e8fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a87ac0a-fd98-48dd-b801-371c0bb9f0e6,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:38.648638 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fd266fda-74d9-4512-ac25-67ddcfa8e8fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:38.649777 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fd266fda-74d9-4512-ac25-67ddcfa8e8fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.653752 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-fd266fda-74d9-4512-ac25-67ddcfa8e8fa admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7a87ac0a-fd98-48dd-b801-371c0bb9f0e6 HTTP/1.1" status: 204  len: 168 time: 0.2372770
May 28 14:23:38.753166 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1c53938e-e7ad-45d4-b888-68a26f60d8fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.758149 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-57d7c155-453d-4ff6-839e-5386f0d49772 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:38.772518 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c53938e-e7ad-45d4-b888-68a26f60d8fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c4d88fa-8ce0-4d09-9a16-4f3ab4af006e,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:38.775407 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-1c53938e-e7ad-45d4-b888-68a26f60d8fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:38.779412 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1c53938e-e7ad-45d4-b888-68a26f60d8fb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:38.780536 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-1c53938e-e7ad-45d4-b888-68a26f60d8fb admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/9c4d88fa-8ce0-4d09-9a16-4f3ab4af006e HTTP/1.1" status: 204  len: 168 time: 0.2514012
May 28 14:23:39.343204 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9206cfaa-483c-4eb3-bd81-1da015f7adef req-0fc09ed1-06b1-418c-87e0-5cd8908e06a1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:39.344689 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9206cfaa-483c-4eb3-bd81-1da015f7adef req-0fc09ed1-06b1-418c-87e0-5cd8908e06a1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0848970
May 28 14:23:39.398491 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9206cfaa-483c-4eb3-bd81-1da015f7adef req-842e723a-1d0b-45c8-a08a-e056a385d129 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0480752
May 28 14:23:39.471351 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59828) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:39.491973 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:39.508906 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:39.516555 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Usage tracker for resource:security_group_rule and tenant:c9a242985eeb444497f38c78115df2b9 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:39.520395 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:39.527082 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:39.615944 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:39.701975 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:39.709996 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-61b60686-c0c8-4d47-a4a0-c979b7c0ed29 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:39.750192 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75a050b2-6fa9-4907-9e73-2b2a658416d5,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:39.754546 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c9a242985eeb444497f38c78115df2b9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2819569
May 28 14:23:39.755461 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:39.757837 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59844) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:39.832229 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0a9f3d54-c24b-47b5-b02c-7d9bc1f017a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:39.858000 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0a9f3d54-c24b-47b5-b02c-7d9bc1f017a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:40.021462 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0a9f3d54-c24b-47b5-b02c-7d9bc1f017a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:40.026367 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-7a9c5465-0d4b-4966-9fb0-f34171f34686 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:40.040283 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a9f3d54-c24b-47b5-b02c-7d9bc1f017a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75a050b2-6fa9-4907-9e73-2b2a658416d5,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:40.042831 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0a9f3d54-c24b-47b5-b02c-7d9bc1f017a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:40.044148 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0a9f3d54-c24b-47b5-b02c-7d9bc1f017a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:40.048116 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-0a9f3d54-c24b-47b5-b02c-7d9bc1f017a9 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/75a050b2-6fa9-4907-9e73-2b2a658416d5 HTTP/1.1" status: 204  len: 168 time: 0.2863622
May 28 14:23:40.596651 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd req-fe27d3e6-2ed6-4130-83f1-f1b0089e04d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:40.598180 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd req-fe27d3e6-2ed6-4130-83f1-f1b0089e04d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0869803
May 28 14:23:40.653481 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c1d0dc95-f39a-4f6c-982c-ee4cbd4d20dd req-e47af76a-5b1c-44b0-8b24-a4db568e0ed1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0491729
May 28 14:23:41.838310 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717cad4f-da3f-49cc-99c6-3c1041f879a4 req-da4c3064-1d07-4f01-a96a-1058c74e8066 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:41.839805 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-717cad4f-da3f-49cc-99c6-3c1041f879a4 req-da4c3064-1d07-4f01-a96a-1058c74e8066 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0809267
May 28 14:23:41.884733 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-717cad4f-da3f-49cc-99c6-3c1041f879a4 req-97df2244-9c60-400e-8cbf-34062c7537c7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387504
May 28 14:23:42.206586 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 59918) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:42.351381 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:42.371876 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:42.375634 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Usage tracker for resource:security_group_rule and tenant:c3551504cb2c48fd81299d0a5adda72c is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:42.379268 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:42.385346 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:42.473989 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:42.593849 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:42.603237 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-4ee32242-aa25-42ed-a09b-4b0940a3293b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:42.644166 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c3551504cb2c48fd81299d0a5adda72c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4365203
May 28 14:23:42.645381 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f58f0030-8985-461a-a9a5-403e697fb8b0,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:42.646890 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 59942) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:42.648632 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:42.704331 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-cef7c314-1b5d-4354-acf2-665a56de58f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:42.730715 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-cef7c314-1b5d-4354-acf2-665a56de58f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:42.838945 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-cef7c314-1b5d-4354-acf2-665a56de58f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:42.850884 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:42.856619 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef7c314-1b5d-4354-acf2-665a56de58f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f58f0030-8985-461a-a9a5-403e697fb8b0,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:42.860525 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-cef7c314-1b5d-4354-acf2-665a56de58f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:42.866638 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-cef7c314-1b5d-4354-acf2-665a56de58f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:42.870360 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-cef7c314-1b5d-4354-acf2-665a56de58f1 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/f58f0030-8985-461a-a9a5-403e697fb8b0 HTTP/1.1" status: 204  len: 168 time: 0.2224433
May 28 14:23:43.074997 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46029d22-ad97-41a1-a513-f4d24015ed32 req-64e5e2c3-6b41-4daa-80af-0c199d9467e1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:43.076632 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-46029d22-ad97-41a1-a513-f4d24015ed32 req-64e5e2c3-6b41-4daa-80af-0c199d9467e1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0812411
May 28 14:23:43.122333 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-46029d22-ad97-41a1-a513-f4d24015ed32 req-dcde3ae0-0937-4310-82a8-56ac4d904ed8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399530
May 28 14:23:44.339755 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db req-d8ec2dc2-50f4-46d5-b8f5-02db08768346 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:44.341478 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db req-d8ec2dc2-50f4-46d5-b8f5-02db08768346 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1028478
May 28 14:23:44.390443 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60054) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:44.399867 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ed0aee7f-ba41-4b21-adc6-4746fcdd91db req-9c38b157-4384-473b-b722-290bc1d4a212 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513005
May 28 14:23:44.528876 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:44.544145 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:44.548290 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Usage tracker for resource:security_group_rule and tenant:ba381c9a9acc40f18752359e91ca2df9 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:44.551062 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:44.557140 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:44.649509 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:44.804912 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:44.814382 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f06b25aa-260b-42e7-aa6a-6633cbe05b26 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:44.855131 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ba381c9a9acc40f18752359e91ca2df9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4635363
May 28 14:23:44.855905 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79e356fc-5304-43e9-9834-794c01538b7a,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:44.858052 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60074) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:44.858874 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:44.921624 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8c24946e-5e44-4470-851d-123b3c822f22 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:44.948112 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8c24946e-5e44-4470-851d-123b3c822f22 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:45.073210 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8c24946e-5e44-4470-851d-123b3c822f22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:45.078337 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-934723b6-29b9-4d5f-b176-1eac5b0a6297 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:45.091088 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c24946e-5e44-4470-851d-123b3c822f22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79e356fc-5304-43e9-9834-794c01538b7a,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:45.100578 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8c24946e-5e44-4470-851d-123b3c822f22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:45.101381 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8c24946e-5e44-4470-851d-123b3c822f22 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:45.103434 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-8c24946e-5e44-4470-851d-123b3c822f22 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/79e356fc-5304-43e9-9834-794c01538b7a HTTP/1.1" status: 204  len: 168 time: 0.2443035
May 28 14:23:45.402827 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9bfd7a-b215-4a05-b321-5d96b6a241b8 req-5ff067b9-3b79-4a7f-8c76-edf0c57e08bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:45.405391 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ce9bfd7a-b215-4a05-b321-5d96b6a241b8 req-5ff067b9-3b79-4a7f-8c76-edf0c57e08bb service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1098 time: 0.1092300
May 28 14:23:45.456195 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ce9bfd7a-b215-4a05-b321-5d96b6a241b8 req-0b1a51d3-37b3-46f1-85ff-adb7dca5dda7 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418129
May 28 14:23:45.598129 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 req-40e1341a-b2d1-45dd-a1c9-b0b70c65690f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:45.599578 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 req-40e1341a-b2d1-45dd-a1c9-b0b70c65690f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0858247
May 28 14:23:45.644300 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5525a75e-91a7-43bc-81e3-e2b36a2895b7 req-303a7080-4426-4c10-81ac-776491af5652 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389929
May 28 14:23:46.609362 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60166) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:46.629995 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:46.644935 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:46.649840 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Usage tracker for resource:security_group_rule and tenant:ea306a15d9be45e3bcb7ab501c0e59b8 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:46.652861 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:46.659160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:46.744213 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:46.823760 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:46.832100 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-828c6d6f-b8bb-4fc1-b46c-dfc37095f953 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:46.878728 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ea306a15d9be45e3bcb7ab501c0e59b8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2681577
May 28 14:23:46.879822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75caa79d-f64d-45ab-8c39-e41066c8f553,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:46.882376 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60172) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:46.883463 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:46.904247 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 req-b6feb1e0-9a3a-448b-a5da-f7e924fff0ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:46.906066 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 req-b6feb1e0-9a3a-448b-a5da-f7e924fff0ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1395080
May 28 14:23:46.998048 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7e4bdb4-cbc6-4837-b316-e4bb00f51051 req-d7e477d9-ddd7-4e74-a29e-0b9cf997530b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0857821
May 28 14:23:47.040184 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9e71b420-1a28-4114-be28-611c67f012b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:47.084348 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9e71b420-1a28-4114-be28-611c67f012b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:47.245755 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9e71b420-1a28-4114-be28-611c67f012b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:47.253086 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-712c1d31-e1fd-4ec4-80b2-c4cf2d0d8064 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:47.270778 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e71b420-1a28-4114-be28-611c67f012b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75caa79d-f64d-45ab-8c39-e41066c8f553,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:47.273162 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9e71b420-1a28-4114-be28-611c67f012b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:47.301272 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9e71b420-1a28-4114-be28-611c67f012b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:47.301272 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-9e71b420-1a28-4114-be28-611c67f012b7 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/75caa79d-f64d-45ab-8c39-e41066c8f553 HTTP/1.1" status: 204  len: 168 time: 0.4101679
May 28 14:23:48.222541 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 req-af967058-cd64-4542-a830-ae5a0203dff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:48.222541 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 req-af967058-cd64-4542-a830-ae5a0203dff6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0896988
May 28 14:23:48.267183 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-49d8d9e4-c417-46e9-8a84-d7bb00b4c920 req-ef8d4f26-7905-4b6f-a8a0-58edccc84b0d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469155
May 28 14:23:48.544524 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:23:48.887913 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f req-fdd3800a-5194-4928-ac62-ea14e8d125e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:48.889442 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f req-fdd3800a-5194-4928-ac62-ea14e8d125e2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0819271
May 28 14:23:48.935677 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-58dee7cb-5ea1-49c6-90b2-4b4b648c474f req-49213fb9-227e-4faa-bbb0-2c5f0290b995 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405130
May 28 14:23:50.127289 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 req-0fa59928-2874-4bdb-900c-27d63fc20b8f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:50.128691 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 req-0fa59928-2874-4bdb-900c-27d63fc20b8f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0840843
May 28 14:23:50.174000 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b52f8775-c5e6-4a42-8234-9fa9fb1598a2 req-22b24342-594c-4f49-bd8e-31d26000ba3d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386212
May 28 14:23:51.365227 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288c6078-e1ad-4c69-8a98-64168b4a356c req-d99fee39-4779-4bde-9f41-4bbcbf52bf48 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:51.366936 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-288c6078-e1ad-4c69-8a98-64168b4a356c req-d99fee39-4779-4bde-9f41-4bbcbf52bf48 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0808630
May 28 14:23:51.412446 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-288c6078-e1ad-4c69-8a98-64168b4a356c req-90f5d78b-4825-449a-9b6a-9038a632a698 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399847
May 28 14:23:52.674402 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 req-1d04fdb5-dbba-45f2-9cda-458a41ecff6d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:52.675876 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 req-1d04fdb5-dbba-45f2-9cda-458a41ecff6d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1415539
May 28 14:23:52.722315 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a693f1ae-e9c2-47ce-832f-6a8df6c33297 req-95b79886-9735-4c05-9381-6bd73d703027 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403178
May 28 14:23:52.912868 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60328) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:53.031018 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:53.045778 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:53.050920 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Usage tracker for resource:security_group_rule and tenant:7824f645894945f1aa9654452dbca350 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:53.053745 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:53.059622 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:53.140454 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:53.221897 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:53.229294 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-cf2c665c-cccb-4fb3-851b-b26dd24a0830 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:53.270309 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=7824f645894945f1aa9654452dbca350&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3562393
May 28 14:23:53.271133 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1b4927f-74d7-415b-a5e3-5e15d843fd0c,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:53.273190 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60334) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:53.274341 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:53.336179 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-85850ed0-05b5-4cc6-94bc-97775c3f8f0e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:53.362514 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-85850ed0-05b5-4cc6-94bc-97775c3f8f0e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:53.559241 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-85850ed0-05b5-4cc6-94bc-97775c3f8f0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:53.565175 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-204b1730-17f0-4c21-be45-0228920862e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:53.577831 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85850ed0-05b5-4cc6-94bc-97775c3f8f0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1b4927f-74d7-415b-a5e3-5e15d843fd0c,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:53.581965 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-85850ed0-05b5-4cc6-94bc-97775c3f8f0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:53.588378 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-85850ed0-05b5-4cc6-94bc-97775c3f8f0e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:53.589472 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-85850ed0-05b5-4cc6-94bc-97775c3f8f0e admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/a1b4927f-74d7-415b-a5e3-5e15d843fd0c HTTP/1.1" status: 204  len: 168 time: 0.3154311
May 28 14:23:53.724779 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-cf9d833e-1619-4b0b-9db7-480b2df20d4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:53.728727 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-cf9d833e-1619-4b0b-9db7-480b2df20d4a service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1098 time: 0.0785725
May 28 14:23:53.948060 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-4bf8781a-cd2d-477e-bc53-2d54bdc0b2c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:53.948060 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-4bf8781a-cd2d-477e-bc53-2d54bdc0b2c6 service neutron] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 920 time: 0.2062466
May 28 14:23:54.017804 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36e3d74-613f-413a-89e5-34c1cd973f60 req-6c13bdab-7255-4649-a169-6dec08c78253 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:54.019301 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e36e3d74-613f-413a-89e5-34c1cd973f60 req-6c13bdab-7255-4649-a169-6dec08c78253 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1849906
May 28 14:23:54.028819 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-a38a641c-23eb-4b99-b030-482fa08881e4 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84 HTTP/1.1" status: 200  len: 217 time: 0.0746098
May 28 14:23:54.120699 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e36e3d74-613f-413a-89e5-34c1cd973f60 req-f9b137b1-8e81-427a-a3d3-b34776fee453 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0936921
May 28 14:23:54.129912 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-2cfeb68f-4991-4f0b-b89f-8268da336fcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:54.131528 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-2cfeb68f-4991-4f0b-b89f-8268da336fcb service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0816283
May 28 14:23:54.187962 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-b1436718-e7ce-4d02-ad9c-d7d35c4dca9e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0409524
May 28 14:23:54.332962 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-57b6713b-2c14-4fad-bc96-7628e522af3c service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1320667
May 28 14:23:54.479746 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-da600fb5-1ef7-4404-85bb-0834a835cc50 req-8f55784b-79fc-4262-b79c-388e372028f8 service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1292696
May 28 14:23:54.575582 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60368) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:54.594009 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:54.608518 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:54.613052 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Usage tracker for resource:security_group_rule and tenant:90749124c5e646519dafa104b6058df6 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:54.616068 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:54.621579 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:54.714172 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:54.781939 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:54.795135 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:54.834295 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=90749124c5e646519dafa104b6058df6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2575135
May 28 14:23:54.836075 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ca7763d-8088-4b2d-ac08-a53237d8bb3b,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:54.837033 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60376) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:54.839210 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:54.904358 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-300e0b84-8b7c-436b-8d8e-545df0849793 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:54.930359 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-300e0b84-8b7c-436b-8d8e-545df0849793 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:55.119529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-300e0b84-8b7c-436b-8d8e-545df0849793 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:55.125042 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0a9f3d54-c24b-47b5-b02c-7d9bc1f017a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:55.135916 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300e0b84-8b7c-436b-8d8e-545df0849793 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ca7763d-8088-4b2d-ac08-a53237d8bb3b,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:55.146081 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-300e0b84-8b7c-436b-8d8e-545df0849793 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:55.163231 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-300e0b84-8b7c-436b-8d8e-545df0849793 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:55.172349 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-300e0b84-8b7c-436b-8d8e-545df0849793 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/0ca7763d-8088-4b2d-ac08-a53237d8bb3b HTTP/1.1" status: 204  len: 168 time: 0.3315921
May 28 14:23:55.330726 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb req-247b2e8e-506a-4d2f-b233-56764863a7ac tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:55.338236 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb req-247b2e8e-506a-4d2f-b233-56764863a7ac tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0949879
May 28 14:23:55.385268 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-88794ce7-8aa8-4b08-b1cb-5a7fd1b5d7cb req-2fa7da9d-fba2-4849-bf03-6ab06d540785 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457790
May 28 14:23:56.584518 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-191a032f-8b73-4685-9416-239309f0376f req-8f0b180c-a593-492b-a39d-a6b342732714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:56.585917 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-191a032f-8b73-4685-9416-239309f0376f req-8f0b180c-a593-492b-a39d-a6b342732714 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0849397
May 28 14:23:56.632139 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-191a032f-8b73-4685-9416-239309f0376f req-dece9b51-5db0-48d4-a307-13c487b005b2 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404191
May 28 14:23:57.753530 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:57.821664 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b0f048-a718-472e-a689-033cd0c8edfb req-186c5b29-f78a-4840-aa71-0b18eb57256f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:57.823298 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d7b0f048-a718-472e-a689-033cd0c8edfb req-186c5b29-f78a-4840-aa71-0b18eb57256f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0842228
May 28 14:23:57.869844 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d7b0f048-a718-472e-a689-033cd0c8edfb req-805751fa-4b8b-43be-9921-a3a55e518557 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408423
May 28 14:23:58.862542 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60500) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:59.010390 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:59.042471 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:23:59.048876 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Usage tracker for resource:security_group_rule and tenant:dae43b2d435742a3adb6713bc3149df1 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:23:59.053104 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:23:59.059773 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:23:59.098645 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 req-34b6c69c-1b32-4294-a592-bb40a36c06aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:23:59.100107 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 req-34b6c69c-1b32-4294-a592-bb40a36c06aa tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1232183
May 28 14:23:59.161478 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ee7a3882-6683-4eec-a6d8-44f1fe7d0a96 req-445314f4-770e-4678-a520-cbdd49a80b13 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0548580
May 28 14:23:59.206102 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:59.284759 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:59.291484 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e717612d-0834-482a-af8c-cc21aaf9da4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:59.333380 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=dae43b2d435742a3adb6713bc3149df1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4737897
May 28 14:23:59.334304 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4db6569c-615d-49fb-b171-ce4f8b91ee06,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:59.336996 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60510) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:23:59.337490 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:59.399729 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a331839a-8cee-4914-aa49-a6a84fcabaab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:59.427698 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a331839a-8cee-4914-aa49-a6a84fcabaab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:59.547396 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a331839a-8cee-4914-aa49-a6a84fcabaab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:59.553264 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f6a6d860-8a0d-468c-bbd7-63426218878f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:23:59.566937 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a331839a-8cee-4914-aa49-a6a84fcabaab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4db6569c-615d-49fb-b171-ce4f8b91ee06,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:23:59.569470 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a331839a-8cee-4914-aa49-a6a84fcabaab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:23:59.581319 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a331839a-8cee-4914-aa49-a6a84fcabaab admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:23:59.582566 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-a331839a-8cee-4914-aa49-a6a84fcabaab admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/4db6569c-615d-49fb-b171-ce4f8b91ee06 HTTP/1.1" status: 204  len: 168 time: 0.2445745
May 28 14:23:59.998919 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b97497c7-55f0-45e1-81e7-6a692d37d4fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:00.256026 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60534) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:00.274040 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:00.290286 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:00.294130 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Usage tracker for resource:security_group_rule and tenant:a1996da3b8ac401e9d19e9e6de09ae26 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:00.297002 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:00.303374 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:00.359291 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09562b00-093c-41b2-9b3f-024950a32d77 req-629b12c6-c2ef-4416-8a8d-24d948b24211 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:00.361261 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-09562b00-093c-41b2-9b3f-024950a32d77 req-629b12c6-c2ef-4416-8a8d-24d948b24211 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0884039
May 28 14:24:00.392234 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:00.472885 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-09562b00-093c-41b2-9b3f-024950a32d77 req-aff35da3-5624-4bc5-8f60-c29ecc553048 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1046269
May 28 14:24:00.479228 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:00.488996 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-cef7c314-1b5d-4354-acf2-665a56de58f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:00.528290 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a1996da3b8ac401e9d19e9e6de09ae26&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2712252
May 28 14:24:00.530689 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3491a899-f759-42ac-a053-4075fa39991a,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:00.532840 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60542) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:00.534202 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:00.596932 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-04379dca-8b96-48e4-af4b-5e77866eb2e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:00.632579 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-04379dca-8b96-48e4-af4b-5e77866eb2e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:00.810948 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-04379dca-8b96-48e4-af4b-5e77866eb2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:00.814955 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3cff3ff9-da95-49ee-8f9a-79eda5a6d51b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:00.828334 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04379dca-8b96-48e4-af4b-5e77866eb2e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3491a899-f759-42ac-a053-4075fa39991a,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:00.832690 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-04379dca-8b96-48e4-af4b-5e77866eb2e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:00.838137 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-04379dca-8b96-48e4-af4b-5e77866eb2e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:00.839462 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-04379dca-8b96-48e4-af4b-5e77866eb2e2 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/3491a899-f759-42ac-a053-4075fa39991a HTTP/1.1" status: 204  len: 168 time: 0.3051591
May 28 14:24:01.672184 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f017eeb0-7cea-407a-8471-554dce5ed6fa req-9ad32e2c-931a-428a-9f22-cfdfe5d7cf30 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:01.673755 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f017eeb0-7cea-407a-8471-554dce5ed6fa req-9ad32e2c-931a-428a-9f22-cfdfe5d7cf30 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0897071
May 28 14:24:01.731187 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f017eeb0-7cea-407a-8471-554dce5ed6fa req-14396969-e4b9-4037-b4a4-c61cccdcb8c7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0503857
May 28 14:24:02.479005 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:02.508335 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a749c68f-611d-47c8-a009-d320b149f851 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:02.946186 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c67b741-221a-4f12-a8e0-09c959a46e7a req-b5cb847a-a8cd-45ae-a1d0-da2358409226 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:02.950562 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3c67b741-221a-4f12-a8e0-09c959a46e7a req-b5cb847a-a8cd-45ae-a1d0-da2358409226 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0846760
May 28 14:24:02.999490 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3c67b741-221a-4f12-a8e0-09c959a46e7a req-9c022655-e69b-4159-a4e9-1b509934352b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461237
May 28 14:24:03.488351 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60618) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:03.614022 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:03.665856 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:03.665856 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Usage tracker for resource:security_group_rule and tenant:e29ae598585d4e1581a7124eac0621e8 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:03.665856 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:03.665856 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:03.730148 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:03.811001 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:03.856304 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:03.866771 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5c6bd1df-3f1e-4766-8b4c-d63b333a7aac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:03.909884 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60634) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:03.910495 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=e29ae598585d4e1581a7124eac0621e8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4205220
May 28 14:24:03.911892 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7534c4db-258e-44a7-b345-1c84c824edc4,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:03.915971 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:03.990558 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4564d871-41b8-4475-b537-a4fa8e5cc01f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:04.018630 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4564d871-41b8-4475-b537-a4fa8e5cc01f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:04.204606 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4564d871-41b8-4475-b537-a4fa8e5cc01f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:04.209578 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a331839a-8cee-4914-aa49-a6a84fcabaab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:04.209776 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90967fb1-b90c-40c5-aa0a-678c8f538205 req-28123812-9a4e-4ad0-85b4-276cd4290261 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:04.211259 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-90967fb1-b90c-40c5-aa0a-678c8f538205 req-28123812-9a4e-4ad0-85b4-276cd4290261 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0909038
May 28 14:24:04.222058 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4564d871-41b8-4475-b537-a4fa8e5cc01f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7534c4db-258e-44a7-b345-1c84c824edc4,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:04.224367 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4564d871-41b8-4475-b537-a4fa8e5cc01f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:04.233318 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4564d871-41b8-4475-b537-a4fa8e5cc01f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:04.237528 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-4564d871-41b8-4475-b537-a4fa8e5cc01f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7534c4db-258e-44a7-b345-1c84c824edc4 HTTP/1.1" status: 204  len: 168 time: 0.3216689
May 28 14:24:04.259711 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-90967fb1-b90c-40c5-aa0a-678c8f538205 req-3bc16523-2b89-4226-9b68-57ebb874ae16 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425045
May 28 14:24:04.945044 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60656) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:04.968612 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:04.983106 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:04.987281 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Usage tracker for resource:security_group_rule and tenant:a0751e972efb461c9bb4870e1758212d is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:04.990254 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:04.997926 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:05.100561 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:05.176051 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:05.184752 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-1c53938e-e7ad-45d4-b888-68a26f60d8fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:05.226697 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a0751e972efb461c9bb4870e1758212d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2805693
May 28 14:24:05.227765 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f092542-53c0-4597-bbcb-829c30c2ec28,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:05.231970 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60668) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:05.232399 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:05.261572 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:05.291945 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5a735ec6-59c6-4652-badb-30f816a4651c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:05.319858 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5a735ec6-59c6-4652-badb-30f816a4651c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:05.462135 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c972ce-a552-4196-952f-21b55b0ebdf5 req-6c0d8aa3-096c-4904-b934-88245a5f4bc7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:05.463620 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d4c972ce-a552-4196-952f-21b55b0ebdf5 req-6c0d8aa3-096c-4904-b934-88245a5f4bc7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0926669
May 28 14:24:05.464659 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5a735ec6-59c6-4652-badb-30f816a4651c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:05.468377 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-04379dca-8b96-48e4-af4b-5e77866eb2e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:05.497664 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a735ec6-59c6-4652-badb-30f816a4651c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f092542-53c0-4597-bbcb-829c30c2ec28,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:05.501712 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5a735ec6-59c6-4652-badb-30f816a4651c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:05.522243 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5a735ec6-59c6-4652-badb-30f816a4651c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:05.523278 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5a735ec6-59c6-4652-badb-30f816a4651c admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/5f092542-53c0-4597-bbcb-829c30c2ec28 HTTP/1.1" status: 204  len: 168 time: 0.2927837
May 28 14:24:05.535152 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d4c972ce-a552-4196-952f-21b55b0ebdf5 req-6e2186b2-cece-4114-ab73-101bc27a8730 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0589581
May 28 14:24:06.746100 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5698fc9c-d42e-4f10-9469-7605b77fe743 req-ae775961-7106-4bf3-8856-cbb07bc4d58f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:06.747505 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5698fc9c-d42e-4f10-9469-7605b77fe743 req-ae775961-7106-4bf3-8856-cbb07bc4d58f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0842254
May 28 14:24:06.808182 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5698fc9c-d42e-4f10-9469-7605b77fe743 req-d9cbc7a5-42c0-4c08-890b-ea38a80531c6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471814
May 28 14:24:09.675780 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60804) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:09.795547 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:09.822106 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:09.827604 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Usage tracker for resource:security_group_rule and tenant:281ea9702ea14f60a5c679e158562cf4 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:09.831020 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:09.836990 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:09.935381 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:10.083611 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:10.083611 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eb63adaf-9c77-411e-a3c8-1bb81089d61b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:10.083611 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83c8af1a-af34-450a-85ea-e7d6931d75f1,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:10.086264 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:10.088912 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=281ea9702ea14f60a5c679e158562cf4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4119251
May 28 14:24:10.092045 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60822) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:10.153525 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-f1c3fbc4-8c71-47d6-aafb-2d647d626a23 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:10.188520 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-f1c3fbc4-8c71-47d6-aafb-2d647d626a23 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:10.340957 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-f1c3fbc4-8c71-47d6-aafb-2d647d626a23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:10.348750 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-31340037-33d8-43f3-98ab-372f6952192c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:10.368174 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1c3fbc4-8c71-47d6-aafb-2d647d626a23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83c8af1a-af34-450a-85ea-e7d6931d75f1,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:10.373654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f1c3fbc4-8c71-47d6-aafb-2d647d626a23 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:10.382040 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-f1c3fbc4-8c71-47d6-aafb-2d647d626a23 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:10.384348 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-f1c3fbc4-8c71-47d6-aafb-2d647d626a23 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/83c8af1a-af34-450a-85ea-e7d6931d75f1 HTTP/1.1" status: 204  len: 168 time: 0.2903113
May 28 14:24:10.411349 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 req-1a2a8b1d-4303-40a1-9ddc-a961e9bae064 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:10.413435 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 req-1a2a8b1d-4303-40a1-9ddc-a961e9bae064 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1104982
May 28 14:24:10.457618 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bcbaefcd-9fa7-49fa-a4a9-caa0b78ee330 req-88b05b98-86d1-4c5e-ba83-42c554750ece tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386193
May 28 14:24:11.035057 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 60846) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:11.054120 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:11.069367 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:11.073564 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Usage tracker for resource:security_group_rule and tenant:cdd02b86f83a4500b9e488b1c7834445 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:11.076556 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:11.082875 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:11.174367 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:11.250021 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:11.257207 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c9b60555-2d36-448d-b3eb-0a40946d4879 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:11.297982 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=cdd02b86f83a4500b9e488b1c7834445&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2617824
May 28 14:24:11.298823 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=877ed214-7bef-40bf-9095-b47a2962df5c,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:11.301138 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60852) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:11.301820 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:11.358907 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ee7ae5a5-3408-4281-92d8-4a1f1e279f65 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:11.383864 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ee7ae5a5-3408-4281-92d8-4a1f1e279f65 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:11.502130 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ee7ae5a5-3408-4281-92d8-4a1f1e279f65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:11.505797 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d4dc94e3-2f97-4ab1-9d24-a3d9b98545ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:11.518819 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee7ae5a5-3408-4281-92d8-4a1f1e279f65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=877ed214-7bef-40bf-9095-b47a2962df5c,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:11.522467 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ee7ae5a5-3408-4281-92d8-4a1f1e279f65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:11.527660 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ee7ae5a5-3408-4281-92d8-4a1f1e279f65 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:11.528746 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-ee7ae5a5-3408-4281-92d8-4a1f1e279f65 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/877ed214-7bef-40bf-9095-b47a2962df5c HTTP/1.1" status: 204  len: 168 time: 0.2266476
May 28 14:24:12.621425 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60886) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:12.739729 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-832991693-network', 'tenant_id': 'eba85ed1a1a14a848b3f33435440dff1'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:24:12.744549 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:12.748301 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Usage tracker for resource:network and tenant:eba85ed1a1a14a848b3f33435440dff1 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:12.751729 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:12.758113 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:12.855988 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Made reservation on behalf of eba85ed1a1a14a848b3f33435440dff1 for: {'network': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:24:12.858396 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:12.871698 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:12.886668 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:12.890408 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Usage tracker for resource:security_group_rule and tenant:eba85ed1a1a14a848b3f33435440dff1 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:12.893374 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:12.899143 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:12.979321 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:13.072221 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:13.076459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-050e3c2c-92d3-46a8-9772-bb18b7f658dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:13.105446 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] vlan segment allocate from pool success with {'vlan_id': 855, 'physical_network': 'physnet1'}  {{(pid=92694) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:24:13.114159 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ae740c4-c94e-4bac-9fd6-dc3f96091cac,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:13.117657 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:13.132256 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:13.132608 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.segments_db [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Added segment 89622796-8108-4109-9bba-4e78e65fc59e of type vlan for network 0d994a91-584d-47dc-9f6d-eb7159fb0da8
May 28 14:24:13.159667 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:13.284698 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:13.286211 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:13.286894 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:13.290463 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:13.389838 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Pushing event updated for resources: {'Network': ['ID=0d994a91-584d-47dc-9f6d-eb7159fb0da8,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:13.392745 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:13.399945 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:24:13.508116 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.8856134
May 28 14:24:13.510850 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 60902) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:13.516296 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Request body: {'subnet': {'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-832991693-subnet', 'tenant_id': 'eba85ed1a1a14a848b3f33435440dff1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:24:13.520950 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:13.524682 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Usage tracker for resource:subnet and tenant:eba85ed1a1a14a848b3f33435440dff1 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:13.528703 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:13.533006 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:13.611167 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Made reservation on behalf of eba85ed1a1a14a848b3f33435440dff1 for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:24:13.613536 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3521847'] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:14.108179 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483451', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3521825'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:14.112853 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:14.187094 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Pushing event updated for resources: {'Subnet': ['ID=09cda8a0-3e03-4e9f-ab1c-ce37af69f629,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:14.191042 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:14.195052 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Checking segment: {'id': '89622796-8108-4109-9bba-4e78e65fc59e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:24:14.195401 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Network hostable DHCP agents. Network: 0d994a91-584d-47dc-9f6d-eb7159fb0da8, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:24:14.278831 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:24:14.404511 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 0d994a91-584d-47dc-9f6d-eb7159fb0da8) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:24:14.414273 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:14.414865 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:14.415265 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ad83c86-c6ba-4ec1-92c8-21868131cbcc None None] Network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:24:14.514451 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.0025420
May 28 14:24:14.608809 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8830c2df-84f0-4cf6-a9a6-6c51c9e1c657 None None] Network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:24:22.258750 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 32808) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:22.383314 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:22.397858 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:22.401639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Usage tracker for resource:security_group_rule and tenant:079cb6f4d2194525813fdcd87077ba2c is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:22.404536 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:22.410495 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:22.496082 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:22.588124 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:22.595818 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ae821cce-1111-4fcf-8bde-c17c275e0312 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:22.638570 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=079cb6f4d2194525813fdcd87077ba2c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3786650
May 28 14:24:22.639489 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58854806-3cb3-4a7e-83c0-88ec582c1120,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:22.641263 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 32816) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:22.648555 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.648911 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.649289 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.649634 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.649974 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.650312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.650677 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.651008 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.651341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.651699 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.652028 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.652453 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:22.657118 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:22.701269 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c8ff4156-6267-4c14-8e88-361c2608765f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:22.726948 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c8ff4156-6267-4c14-8e88-361c2608765f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:22.873006 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c8ff4156-6267-4c14-8e88-361c2608765f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:22.877986 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-207fb4ac-6558-4a91-9652-dcc72aff2772 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:22.889912 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ff4156-6267-4c14-8e88-361c2608765f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58854806-3cb3-4a7e-83c0-88ec582c1120,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:22.894204 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c8ff4156-6267-4c14-8e88-361c2608765f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:22.900692 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c8ff4156-6267-4c14-8e88-361c2608765f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:22.900692 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-c8ff4156-6267-4c14-8e88-361c2608765f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/58854806-3cb3-4a7e-83c0-88ec582c1120 HTTP/1.1" status: 204  len: 168 time: 0.2554955
May 28 14:24:23.487110 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 32838) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:23.505685 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:23.520397 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:23.524188 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Usage tracker for resource:security_group_rule and tenant:386e99b3d51843de9b36ddfda613cccb is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:23.526953 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:23.532601 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:23.622558 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:23.690498 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:23.697669 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-3711432e-1bea-4079-ab97-b51893c2b1a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:23.742183 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=386e99b3d51843de9b36ddfda613cccb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2539551
May 28 14:24:23.742918 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8be6451-8f51-479e-ae88-99b2bf3d8cab,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:23.744984 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 32842) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:23.751010 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.751390 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.751746 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.752532 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.752532 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.752808 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.753067 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.753401 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.753735 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.754068 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.754404 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.754732 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:23.758950 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:23.810259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fe587e49-8140-486f-afff-906663e4fda1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:23.838491 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fe587e49-8140-486f-afff-906663e4fda1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:24.045252 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fe587e49-8140-486f-afff-906663e4fda1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:24.051981 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-4ba4fc17-553d-4999-b124-2bef703ad40c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:24.064538 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe587e49-8140-486f-afff-906663e4fda1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8be6451-8f51-479e-ae88-99b2bf3d8cab,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:24.069333 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fe587e49-8140-486f-afff-906663e4fda1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:24.086217 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fe587e49-8140-486f-afff-906663e4fda1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:24.096381 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-fe587e49-8140-486f-afff-906663e4fda1 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b8be6451-8f51-479e-ae88-99b2bf3d8cab HTTP/1.1" status: 204  len: 168 time: 0.3469925
May 28 14:24:25.544919 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:24:27.782273 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:29.999314 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2650b21f-5763-40fb-9705-6cb52ce477dc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:31.215378 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-13d3f72f-19ad-40fb-81c6-e1498539a1b2 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0725119
May 28 14:24:32.507339 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:32.540522 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a4672e79-7b85-4fd9-92a9-60c056494668 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:33.255394 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-01c39af8-f28a-41b9-a602-2380842fa564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:33.256856 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-01c39af8-f28a-41b9-a602-2380842fa564 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 1098 time: 0.0754468
May 28 14:24:33.409224 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-15eaede6-8c43-4b04-9143-a15adc43c10b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:33.410669 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-15eaede6-8c43-4b04-9143-a15adc43c10b service neutron] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 920 time: 0.1316476
May 28 14:24:33.550834 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-b9f98ef8-f1a0-4853-a860-08f0450e26b0 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9328e999-33b7-4ad7-9796-283089726539 HTTP/1.1" status: 200  len: 217 time: 0.1315274
May 28 14:24:33.619596 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-a8ac1b5d-f32e-40e5-bbc7-7b09f0cb989e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:33.619596 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-a8ac1b5d-f32e-40e5-bbc7-7b09f0cb989e service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0589900
May 28 14:24:33.664213 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-ea93a93b-dad1-468a-99bb-e0ad310ee7be service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0398171
May 28 14:24:33.684855 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:33.798683 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-cea4a9e7-0ae4-4733-9913-a3d80b0956be service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1267638
May 28 14:24:33.937268 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddd30ec7-3545-45de-af3f-9b89a001d9dc req-6e328bb0-9358-4269-9765-e19325b47354 service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1282830
May 28 14:24:35.271988 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:38.524091 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33102) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:38.653074 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:38.672841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:38.676765 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Usage tracker for resource:security_group_rule and tenant:0230ab92876c4a18b6df6d5cfee2b618 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:38.679775 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:38.686472 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:38.789176 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:38.901713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:38.909044 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c2037c5f-7fde-41fa-93bf-fb5151b79170 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:38.950780 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1c0f6db-bd39-4b9f-92c5-b6f3a748abb0,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:38.956332 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=0230ab92876c4a18b6df6d5cfee2b618&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4300911
May 28 14:24:38.956332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:38.957960 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33120) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:39.019236 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cc31eb1-11ec-4dd5-ae31-74ab97888f1b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:39.045615 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cc31eb1-11ec-4dd5-ae31-74ab97888f1b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:39.215051 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cc31eb1-11ec-4dd5-ae31-74ab97888f1b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:39.219419 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-904d8d3f-8350-4205-bea5-693c80f446fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:39.232321 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc31eb1-11ec-4dd5-ae31-74ab97888f1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1c0f6db-bd39-4b9f-92c5-b6f3a748abb0,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:39.236747 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5cc31eb1-11ec-4dd5-ae31-74ab97888f1b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:39.242340 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cc31eb1-11ec-4dd5-ae31-74ab97888f1b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:39.243450 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5cc31eb1-11ec-4dd5-ae31-74ab97888f1b admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/a1c0f6db-bd39-4b9f-92c5-b6f3a748abb0 HTTP/1.1" status: 204  len: 168 time: 0.2843790
May 28 14:24:39.645449 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-60151e48-e223-4b38-9158-a827d0065042 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:39.646149 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-60151e48-e223-4b38-9158-a827d0065042 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Synchronizing usage tracker for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:network {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:24:39.776140 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-60151e48-e223-4b38-9158-a827d0065042 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Unset dirty status for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:network {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:24:39.777321 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-60151e48-e223-4b38-9158-a827d0065042 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/networks?id=0d994a91-584d-47dc-9f6d-eb7159fb0da8 HTTP/1.1" status: 200  len: 808 time: 0.3118320
May 28 14:24:39.792256 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-e6b71c7f-2f54-487c-a37a-ef610813083b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/quotas/eba85ed1a1a14a848b3f33435440dff1 HTTP/1.1" status: 200  len: 375 time: 0.0090411
May 28 14:24:39.841727 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-04131a98-ad17-4b96-9d85-3467ddbb8144 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=eba85ed1a1a14a848b3f33435440dff1&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0444400
May 28 14:24:39.977775 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-fecde43f-cc72-40cd-b73e-5350302b8a07 service neutron] 10.222.0.59 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1288211
May 28 14:24:40.111570 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-f6ca5286-a0c0-4f07-826a-b0f7e59f7488 service neutron] 10.222.0.59 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1281226
May 28 14:24:40.213384 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33148) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:40.230220 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:40.245523 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:40.250575 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Usage tracker for resource:security_group_rule and tenant:231117cc25004cc4b2a6fc37c0904418 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:40.253612 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:40.259777 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:40.345294 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:40.536811 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:40.547035 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0ebd1566-acdc-4879-a2a1-2c864408b14c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:40.588665 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=231117cc25004cc4b2a6fc37c0904418&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3741963
May 28 14:24:40.591650 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33166) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:40.607277 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6575c6eb-f7df-4b71-9a4c-bbf234de5ffd,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:40.610968 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:40.640281 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b1cb578-5c93-46e8-9afe-876f75c1c327 req-cc26a2e9-3aee-49aa-8374-f5389f1da063 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.0865140
May 28 14:24:40.673137 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-11bc80bb-6d4e-49f1-a301-02337a5f514f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:40.701519 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-11bc80bb-6d4e-49f1-a301-02337a5f514f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:40.867619 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-11bc80bb-6d4e-49f1-a301-02337a5f514f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:40.872049 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-968cdbc3-6586-4594-a9cb-12975011b243 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:40.883108 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bc80bb-6d4e-49f1-a301-02337a5f514f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6575c6eb-f7df-4b71-9a4c-bbf234de5ffd,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:40.885722 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-11bc80bb-6d4e-49f1-a301-02337a5f514f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:40.895530 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-11bc80bb-6d4e-49f1-a301-02337a5f514f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:40.900412 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-11bc80bb-6d4e-49f1-a301-02337a5f514f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/6575c6eb-f7df-4b71-9a4c-bbf234de5ffd HTTP/1.1" status: 204  len: 168 time: 0.3038683
May 28 14:24:41.737064 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8bb2665a-49be-4a47-a914-50ea7d9aec98 req-c6b072c9-061b-400b-99f5-ab5dde0ba6db tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.0466988
May 28 14:24:42.904578 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2d392667-1a73-4adb-96d2-6b7b0fb6fa32 req-0e93ef3c-e23e-4683-9b79-98feda96a855 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.0498412
May 28 14:24:44.115004 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-169709a4-f3cc-4317-a6fb-b29e4ed1bc29 req-8406aa2b-a8a1-488f-9026-69940cb7f35c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.0499067
May 28 14:24:44.630047 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 req-40cb084d-6f20-48d8-a65c-9fe8b361ba45 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:44.631515 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 req-40cb084d-6f20-48d8-a65c-9fe8b361ba45 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0864260
May 28 14:24:44.676784 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-102f24c1-f93d-40b6-82b5-5475a3cc16f8 req-4fea4b18-1471-4077-9fd8-7b32d203473a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394607
May 28 14:24:45.271683 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-634208ae-9f28-48c7-8b17-362756468f11 req-0eba7985-0dad-460f-b60d-19ef86eb29b8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.0439343
May 28 14:24:45.885968 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 req-b6130d37-c37f-4ed7-bbad-360497267b58 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:45.887437 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 req-b6130d37-c37f-4ed7-bbad-360497267b58 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0829296
May 28 14:24:45.933374 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5eeefe7a-2b7d-47ec-9053-d6fbdcb39fd3 req-372109c3-d3c6-4553-ad11-7ce802aa11a7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397105
May 28 14:24:46.435940 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5e3406b5-16ca-4d80-9784-93aff3d5756a req-8711e6ff-2ddf-4dab-9d0f-83db456876fd tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.0508099
May 28 14:24:47.179859 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09fb413a-2bd5-4734-895a-bffc82043ece req-b4e5f0bd-8261-4261-9fd3-84d6046baaa4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:47.181361 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-09fb413a-2bd5-4734-895a-bffc82043ece req-b4e5f0bd-8261-4261-9fd3-84d6046baaa4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1436195
May 28 14:24:47.226008 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-09fb413a-2bd5-4734-895a-bffc82043ece req-932114e9-300c-421a-93d5-4de612544c9d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389180
May 28 14:24:47.591862 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4c9ca73f-de82-4f3c-ac56-6c32009bd83d req-bca9f719-0f3a-45fe-a0a7-b74984b423dd tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.0413046
May 28 14:24:48.381252 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-dfd1290e-730c-431e-80d2-79a40aa47bec tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:48.382690 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-dfd1290e-730c-431e-80d2-79a40aa47bec tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.90 "GET /v2.0/networks?id=0d994a91-584d-47dc-9f6d-eb7159fb0da8 HTTP/1.1" status: 200  len: 808 time: 0.2135274
May 28 14:24:48.402788 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-c03a6876-8b89-44ef-b52b-6fd987aeb20d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:48.404330 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-c03a6876-8b89-44ef-b52b-6fd987aeb20d service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1098 time: 0.2093174
May 28 14:24:48.431457 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c22f858-53df-4c6a-b0b5-442dda71bb4c req-517671df-57f6-4f04-87e0-fe5cbf2bb2c3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:48.433619 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5c22f858-53df-4c6a-b0b5-442dda71bb4c req-517671df-57f6-4f04-87e0-fe5cbf2bb2c3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0891991
May 28 14:24:48.480728 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5c22f858-53df-4c6a-b0b5-442dda71bb4c req-a7cb17cc-5e57-4b1c-9f02-4329c393482e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416875
May 28 14:24:48.624012 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Request body: {'port': {'device_id': '3a422bf7-82c2-409e-a573-929842d0cff3', 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8', 'admin_state_up': True, 'tenant_id': 'eba85ed1a1a14a848b3f33435440dff1'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:24:48.841700 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5ec7c51c-fb3c-43eb-8cf5-88f94a2cc619 req-73f39a21-c41b-4d82-a85d-e7b92824bfa5 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.1268799
May 28 14:24:48.921342 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-82281521-b3a5-4e54-abff-f7e2a78a4640 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:48.923323 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-82281521-b3a5-4e54-abff-f7e2a78a4640 service neutron] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 920 time: 0.3057406
May 28 14:24:48.924339 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:48.928720 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Usage tracker for resource:port and tenant:eba85ed1a1a14a848b3f33435440dff1 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:48.932290 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:48.993437 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:49.011414 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-dee82ccb-429b-472a-99e7-2a4a80b264cc service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84 HTTP/1.1" status: 200  len: 217 time: 0.0727167
May 28 14:24:49.077708 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-2dcd4744-c512-4cd6-be9e-1e687529fa74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:49.080546 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-2dcd4744-c512-4cd6-be9e-1e687529fa74 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0606108
May 28 14:24:49.127353 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Made reservation on behalf of eba85ed1a1a14a848b3f33435440dff1 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:24:49.130855 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:49.150675 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-6383af6e-58dc-42c6-95c5-80c7f0e5ecb7 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0593641
May 28 14:24:49.483219 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-bf78a518-af7d-4de6-b015-79dde9b08447 service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3225534
May 28 14:24:49.494420 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Allocated IP 172.20.0.6 (0d994a91-584d-47dc-9f6d-eb7159fb0da8/09cda8a0-3e03-4e9f-ab1c-ce37af69f629/3c609de4-4752-48b6-81cf-9335e2a7a542) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:24:49.805415 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-df82ac5b-96cf-4b60-9454-690e740c7c4f req-dd22fcb6-f8c9-4899-99d6-66f613cad3b6 service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3086438
May 28 14:24:49.842038 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63685f05-a30d-4e91-a317-21e9070fd355 req-bf9f93af-7187-439e-851f-2a70a4e90f25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:49.843523 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-63685f05-a30d-4e91-a317-21e9070fd355 req-bf9f93af-7187-439e-851f-2a70a4e90f25 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.2524431
May 28 14:24:49.938182 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:49.943513 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-63685f05-a30d-4e91-a317-21e9070fd355 req-41e2df9f-9e54-4115-bd7e-d6c9557742df tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0858421
May 28 14:24:50.005013 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-61de225b-6f0f-4485-a9b1-13e5592564d3 req-60161a93-7082-440c-9351-4aeeef5f3a7a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.0429728
May 28 14:24:50.102163 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:50.108336 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:50.174904 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:24:50.178218 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:24:50.181075 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:24:50.223307 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Pushing event updated for resources: {'Port': ['ID=3c609de4-4752-48b6-81cf-9335e2a7a542,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:50.227791 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:50.257479 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:50.258075 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:50.403313 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7842863
May 28 14:24:50.421250 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Request body: {'port': {'device_id': '3a422bf7-82c2-409e-a573-929842d0cff3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:24:50.536774 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:50.910065 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3c609de4-4752-48b6-81cf-9335e2a7a542 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:24:50.919126 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:50.939431 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Transition to ACTIVE for port object 3c609de4-4752-48b6-81cf-9335e2a7a542 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:24:51.084439 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:51.090848 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-10c9ce62-4326-4a41-9e29-85a549924fdd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:51.189809 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029f305e-065f-463c-810d-71a26b306acf req-28869281-f4bc-4c38-a5a7-212858510c61 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:51.191311 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-029f305e-065f-463c-810d-71a26b306acf req-28869281-f4bc-4c38-a5a7-212858510c61 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1276920
May 28 14:24:51.248325 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-029f305e-065f-463c-810d-71a26b306acf req-438e4408-4083-4b5f-892b-009ab3e74fc3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0498562
May 28 14:24:51.294813 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Pushing event updated for resources: {'Port': ['ID=3c609de4-4752-48b6-81cf-9335e2a7a542,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:51.328220 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:51.432962 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-813b547b-0144-4946-8ecd-a21e6d13022e req-6245fa5e-7b80-4f48-8de3-fb56d7bd73d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:51.432962 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-813b547b-0144-4946-8ecd-a21e6d13022e req-6245fa5e-7b80-4f48-8de3-fb56d7bd73d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Synchronizing usage tracker for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:24:51.437159 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Attempting to bind port 3c609de4-4752-48b6-81cf-9335e2a7a542 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:24:51.437519 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Attempting to bind port 3c609de4-4752-48b6-81cf-9335e2a7a542 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '89622796-8108-4109-9bba-4e78e65fc59e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:24:51.437845 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Attempting to bind port 3c609de4-4752-48b6-81cf-9335e2a7a542 on network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:24:51.445473 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Port 3c609de4-4752-48b6-81cf-9335e2a7a542 on network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:24:51.445817 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Attempting to bind port 3c609de4-4752-48b6-81cf-9335e2a7a542 on network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:24:51.455151 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 24, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:24:51.455498 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Checking segment: {'id': '89622796-8108-4109-9bba-4e78e65fc59e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:24:51.455907 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Bound using segment: {'id': '89622796-8108-4109-9bba-4e78e65fc59e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:24:51.461578 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Bound port: 3c609de4-4752-48b6-81cf-9335e2a7a542, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '89622796-8108-4109-9bba-4e78e65fc59e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:24:51.461578 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:51.565403 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-813b547b-0144-4946-8ecd-a21e6d13022e req-6245fa5e-7b80-4f48-8de3-fb56d7bd73d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Unset dirty status for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:24:51.572411 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-813b547b-0144-4946-8ecd-a21e6d13022e req-6245fa5e-7b80-4f48-8de3-fb56d7bd73d3 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 943 time: 0.4192038
May 28 14:24:51.574745 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] For port 3c609de4-4752-48b6-81cf-9335e2a7a542, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:24:51.579466 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] For port 3c609de4-4752-48b6-81cf-9335e2a7a542, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=3c609de4-4752-48b6-81cf-9335e2a7a542,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:24:51.620634 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-813b547b-0144-4946-8ecd-a21e6d13022e req-5231bb7f-afa6-4117-9898-90f1b761e056 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454409
May 28 14:24:51.635893 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33450) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:51.662335 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:51.668884 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:51.773215 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:51.789001 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:51.792608 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Usage tracker for resource:security_group_rule and tenant:263acc4d67894856a5b861d54e111b0f is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:51.795442 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:51.801457 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:51.820914 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:51.825865 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:51.825865 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-a4faea29-9978-4210-ba17-836e1232600c service neutron] 10.222.0.90 "PUT /v2.0/ports/3c609de4-4752-48b6-81cf-9335e2a7a542 HTTP/1.1" status: 200  len: 1093 time: 1.4058838
May 28 14:24:51.825865 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3a422bf7-82c2-409e-a573-929842d0cff3', 'tag': '3c609de4-4752-48b6-81cf-9335e2a7a542'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:24:51.846990 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Pushing event updated for resources: {'Port': ['ID=3c609de4-4752-48b6-81cf-9335e2a7a542,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:51.850423 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:51.915944 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:52.038619 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3a422bf7-82c2-409e-a573-929842d0cff3', 'tag': '3c609de4-4752-48b6-81cf-9335e2a7a542', 'status': 'completed', 'code': 200}
May 28 14:24:52.044266 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:52.054011 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-11bc80bb-6d4e-49f1-a301-02337a5f514f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:52.058716 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-c023aa8f-57f6-4560-8a83-7f3ea713f887 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:52.060396 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-c023aa8f-57f6-4560-8a83-7f3ea713f887 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=eba85ed1a1a14a848b3f33435440dff1&device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 1096 time: 0.0847740
May 28 14:24:52.095382 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=263acc4d67894856a5b861d54e111b0f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4583824
May 28 14:24:52.096446 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51bf4815-c1ce-4d7a-b369-aa4f54988727,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:52.098784 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33460) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:52.101303 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:52.144048 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-167afe78-92c7-48a6-a066-10028fd690c4 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3c609de4-4752-48b6-81cf-9335e2a7a542 HTTP/1.1" status: 200  len: 217 time: 0.0699785
May 28 14:24:52.164852 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1fcd7cb-4e22-4d38-83a6-89e105716060 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:52.192503 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1fcd7cb-4e22-4d38-83a6-89e105716060 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:52.215673 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-1c7c1c7f-25fa-4be1-a3d4-e12c81e559c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:52.219589 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-1c7c1c7f-25fa-4be1-a3d4-e12c81e559c7 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=09cda8a0-3e03-4e9f-ab1c-ce37af69f629 HTTP/1.1" status: 200  len: 848 time: 0.0640872
May 28 14:24:52.269953 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-c8148bba-2aea-405e-87e8-6a20f57e2246 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=0d994a91-584d-47dc-9f6d-eb7159fb0da8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0422657
May 28 14:24:52.335227 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1fcd7cb-4e22-4d38-83a6-89e105716060 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:52.339223 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d96967cd-e17d-487a-8b83-61e20894df5c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:52.355028 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1fcd7cb-4e22-4d38-83a6-89e105716060 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51bf4815-c1ce-4d7a-b369-aa4f54988727,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:52.357736 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e1fcd7cb-4e22-4d38-83a6-89e105716060 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:52.362962 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1fcd7cb-4e22-4d38-83a6-89e105716060 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:52.365524 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e1fcd7cb-4e22-4d38-83a6-89e105716060 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/51bf4815-c1ce-4d7a-b369-aa4f54988727 HTTP/1.1" status: 204  len: 168 time: 0.2655849
May 28 14:24:52.426756 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-0bf7c4f5-2243-4b85-ac46-4f69f6fec0be service neutron] 10.222.0.90 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1447339
May 28 14:24:52.469924 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ad5b07a-84c2-4bf1-9119-01f476800f3a req-d80d7499-e38a-41b4-8fd9-07d3bf6e97f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:52.471354 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8ad5b07a-84c2-4bf1-9119-01f476800f3a req-d80d7499-e38a-41b4-8fd9-07d3bf6e97f8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0947633
May 28 14:24:52.520932 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8ad5b07a-84c2-4bf1-9119-01f476800f3a req-f5d5fd40-61af-466d-a33e-0e7ecd084d4d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435359
May 28 14:24:52.579149 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a51801a3-2021-402e-9c45-bedcf03e50e9 req-7af9b93d-7158-4737-8ce2-d61224941ef5 service neutron] 10.222.0.90 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1455564
May 28 14:24:52.872678 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-3f361d41-4480-4f3f-b793-e0d877f360e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:52.873914 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-3f361d41-4480-4f3f-b793-e0d877f360e0 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=eba85ed1a1a14a848b3f33435440dff1&device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 1096 time: 0.1394353
May 28 14:24:52.915719 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19132cff-7980-4ee4-91be-98e8b312c4d9 req-fd09ee02-2560-4a50-ac03-9d31f5b1e7d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:52.917167 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-19132cff-7980-4ee4-91be-98e8b312c4d9 req-fd09ee02-2560-4a50-ac03-9d31f5b1e7d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 943 time: 0.1400018
May 28 14:24:53.037489 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-19132cff-7980-4ee4-91be-98e8b312c4d9 req-b053314b-a4c0-4060-8436-6580736d0754 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0701921
May 28 14:24:53.067755 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-7c083ab7-0e1f-4e39-83fa-365597e01406 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:53.069240 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-7c083ab7-0e1f-4e39-83fa-365597e01406 service neutron] 10.222.0.90 "GET /v2.0/networks?id=0d994a91-584d-47dc-9f6d-eb7159fb0da8 HTTP/1.1" status: 200  len: 909 time: 0.1871858
May 28 14:24:53.144953 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-347bbf20-803b-47de-809b-8e4a3c186d9a service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3c609de4-4752-48b6-81cf-9335e2a7a542 HTTP/1.1" status: 200  len: 217 time: 0.0673373
May 28 14:24:53.216792 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-8882d4f2-67e7-47eb-8c4a-132a4b56ef9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:53.218424 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-8882d4f2-67e7-47eb-8c4a-132a4b56ef9a service neutron] 10.222.0.90 "GET /v2.0/subnets?id=09cda8a0-3e03-4e9f-ab1c-ce37af69f629 HTTP/1.1" status: 200  len: 848 time: 0.0660625
May 28 14:24:53.273864 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-cd5b1b16-998c-47b1-b8ed-b280bec2b369 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=0d994a91-584d-47dc-9f6d-eb7159fb0da8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0473824
May 28 14:24:53.423766 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-71a8fb0c-0322-4be3-9aab-1716771fb155 service neutron] 10.222.0.90 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1403370
May 28 14:24:53.577389 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0dd503df-1d5a-4669-82e5-b4a344074ad5 req-3bbb7864-0a3d-4f61-91ca-02f3a44ee5b2 service neutron] 10.222.0.90 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1326797
May 28 14:24:53.743582 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1fef28-4365-4e09-96a9-f85e635e0699 req-657a4f4a-4853-457e-9789-b16be90d952f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:53.745391 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5c1fef28-4365-4e09-96a9-f85e635e0699 req-657a4f4a-4853-457e-9789-b16be90d952f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0967705
May 28 14:24:53.798684 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5c1fef28-4365-4e09-96a9-f85e635e0699 req-035e7b79-204e-4ac6-9a86-720273f2fa21 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432539
May 28 14:24:54.315857 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 req-0ffd2650-f37c-480a-83ab-c8ad57de5cbe tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:54.326229 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 req-0ffd2650-f37c-480a-83ab-c8ad57de5cbe tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 943 time: 0.1695249
May 28 14:24:54.362883 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07117c65-a7ae-4a78-9cd3-5131e346a2d8 req-ea3865e0-3871-4119-aa1f-63a13557fe07 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399046
May 28 14:24:54.528855 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33534) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:54.650496 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:54.666155 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:54.669904 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Usage tracker for resource:security_group_rule and tenant:f58449dedc4e45faa3479e1f68f174d4 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:54.673312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:54.679074 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:54.769730 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:54.936636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:54.944411 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-014b8368-f1ea-463e-8c73-07912a2e6b9b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:54.989616 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=f58449dedc4e45faa3479e1f68f174d4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4596782
May 28 14:24:54.990605 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d9e3f1e-7fee-48b3-9c1a-1ab704b7e8bb,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:54.993454 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33546) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:55.004131 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:55.008441 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 req-0ffb7887-6f50-4751-af74-e1d34475a33c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:55.009832 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 req-0ffb7887-6f50-4751-af74-e1d34475a33c tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0955944
May 28 14:24:55.058967 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80fec171-eb5d-4de6-8081-b7cd12dbc9b2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:55.061381 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bcf791b7-8811-4c2d-865e-2c6d9a7d1523 req-77daf28d-6177-44b2-89e3-d968a12f8271 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0453501
May 28 14:24:55.087295 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80fec171-eb5d-4de6-8081-b7cd12dbc9b2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:55.284598 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80fec171-eb5d-4de6-8081-b7cd12dbc9b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:55.288654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fe587e49-8140-486f-afff-906663e4fda1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:55.302074 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80fec171-eb5d-4de6-8081-b7cd12dbc9b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d9e3f1e-7fee-48b3-9c1a-1ab704b7e8bb,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:55.304957 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-80fec171-eb5d-4de6-8081-b7cd12dbc9b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:55.318000 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-80fec171-eb5d-4de6-8081-b7cd12dbc9b2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:55.318000 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-80fec171-eb5d-4de6-8081-b7cd12dbc9b2 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7d9e3f1e-7fee-48b3-9c1a-1ab704b7e8bb HTTP/1.1" status: 204  len: 168 time: 0.3136942
May 28 14:24:55.574608 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 req-039c395b-ae14-4796-b187-5a021980e23c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:55.576103 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 req-039c395b-ae14-4796-b187-5a021980e23c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 943 time: 0.0933561
May 28 14:24:55.624627 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 req-79e207f8-ea81-40f9-8e6f-9dd12b257a2c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Synchronizing usage tracker for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:24:55.742172 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 req-79e207f8-ea81-40f9-8e6f-9dd12b257a2c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Unset dirty status for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:24:55.743367 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f8b00e60-7f0a-4ca7-b339-504fa18ec4b3 req-79e207f8-ea81-40f9-8e6f-9dd12b257a2c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1596880
May 28 14:24:56.259841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7caf8c93-a985-4655-913e-da059b93e5ea req-f029058c-9d77-47c1-b26f-e0c88efbb2e1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:56.262071 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7caf8c93-a985-4655-913e-da059b93e5ea req-f029058c-9d77-47c1-b26f-e0c88efbb2e1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0879967
May 28 14:24:56.322190 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7caf8c93-a985-4655-913e-da059b93e5ea req-14b081a1-4b51-4619-be55-a1fd2dd0f624 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0527852
May 28 14:24:56.942361 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce req-f023555a-4806-4480-8f1c-eec5c00df53d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:56.943830 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce req-f023555a-4806-4480-8f1c-eec5c00df53d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 943 time: 0.0805273
May 28 14:24:56.987678 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-12e41dc0-dd16-4b67-a8d5-e1fd5e9348ce req-267ba383-27f9-4e3d-b006-0a1f70fcc1ff tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0379345
May 28 14:24:57.527548 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10f247d-b5e5-47a2-93af-9c2914acd98f req-fe3f1ace-ebb7-48a6-8041-a44063174cef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:57.528964 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e10f247d-b5e5-47a2-93af-9c2914acd98f req-fe3f1ace-ebb7-48a6-8041-a44063174cef tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0842638
May 28 14:24:57.576386 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e10f247d-b5e5-47a2-93af-9c2914acd98f req-1d982c6e-c916-4f44-92da-9566eb0c8bb6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410943
May 28 14:24:57.698555 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33598) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:57.787485 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:57.816514 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:57.832774 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:57.836847 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Usage tracker for resource:security_group_rule and tenant:406bf5e8c0ea41f289151c11b3a9f3ce is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:57.839795 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:57.846543 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:57.928437 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:58.015980 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:58.024875 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5a735ec6-59c6-4652-badb-30f816a4651c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:58.069149 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=406bf5e8c0ea41f289151c11b3a9f3ce&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3695161
May 28 14:24:58.071790 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33606) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:58.074793 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a40c3ff-81aa-46fa-9a03-cc10b2de7e98,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:58.087336 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:58.204878 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc6db586-3cc0-4be5-994f-07ccd378c1b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:58.241112 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b req-86628c9f-d52f-442b-ae91-553e83e4ecff tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:58.242827 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b req-86628c9f-d52f-442b-ae91-553e83e4ecff tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 943 time: 0.1385789
May 28 14:24:58.251681 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc6db586-3cc0-4be5-994f-07ccd378c1b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:58.320467 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b06f85a3-4d74-4af9-b6cd-7cdefb5fcc7b req-f2a90e2f-3a32-4245-ab3c-e1bd2bf7bbba tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0711472
May 28 14:24:58.443503 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc6db586-3cc0-4be5-994f-07ccd378c1b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:58.448520 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eb09eeae-ef6e-4165-8616-a162833c9f54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:58.468445 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc6db586-3cc0-4be5-994f-07ccd378c1b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a40c3ff-81aa-46fa-9a03-cc10b2de7e98,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:58.472885 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc6db586-3cc0-4be5-994f-07ccd378c1b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:58.477020 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc6db586-3cc0-4be5-994f-07ccd378c1b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:58.480656 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-dc6db586-3cc0-4be5-994f-07ccd378c1b5 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/4a40c3ff-81aa-46fa-9a03-cc10b2de7e98 HTTP/1.1" status: 204  len: 168 time: 0.4055293
May 28 14:24:58.616453 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 3c609de4-4752-48b6-81cf-9335e2a7a542 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:24:58.766650 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 3c609de4-4752-48b6-81cf-9335e2a7a542, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=3c609de4-4752-48b6-81cf-9335e2a7a542,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:24:58.777575 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 req-e5d668a1-aed9-4164-986d-4aa7a96b60c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:58.777575 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 req-e5d668a1-aed9-4164-986d-4aa7a96b60c8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0872991
May 28 14:24:58.781427 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '3c609de4-4752-48b6-81cf-9335e2a7a542', 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8', 'port_id': '3c609de4-4752-48b6-81cf-9335e2a7a542', 'mac_address': 'fa:16:3e:ab:69:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 855, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '09cda8a0-3e03-4e9f-ab1c-ce37af69f629', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:24:58.826258 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3d5363b3-93b6-4e96-b7e5-c94c436f7387 req-db9565eb-c948-4a67-b89d-d0b01f4b8330 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447197
May 28 14:24:58.844564 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:58.873301 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3c609de4-4752-48b6-81cf-9335e2a7a542 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:24:58.890040 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 3c609de4-4752-48b6-81cf-9335e2a7a542, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=3c609de4-4752-48b6-81cf-9335e2a7a542,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:24:58.958660 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:58.960775 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-81068cd9-b53c-4fb4-b411-9a905602769d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:24:59.039982 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=3c609de4-4752-48b6-81cf-9335e2a7a542,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:24:59.050082 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.050082 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.050082 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.050082 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.050082 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.050082 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.050594 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.050964 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.051374 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.051855 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.052244 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.052635 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:24:59.056819 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:24:59.515603 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47d149d-d2b0-4950-95df-1a05fd4861a3 req-29731424-5860-4a0d-9325-d91af5cbf677 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:24:59.517175 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d47d149d-d2b0-4950-95df-1a05fd4861a3 req-29731424-5860-4a0d-9325-d91af5cbf677 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 944 time: 0.0820248
May 28 14:24:59.565815 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d47d149d-d2b0-4950-95df-1a05fd4861a3 req-9c737572-2a10-460b-9725-595a85d9b358 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420196
May 28 14:24:59.671055 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['3c609de4-4752-48b6-81cf-9335e2a7a542'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:24:59.704041 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33666) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:24:59.822038 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-87445087-network', 'tenant_id': '1db248e02dac49bf8688658eb42ee752'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:24:59.826689 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:59.831098 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Usage tracker for resource:network and tenant:1db248e02dac49bf8688658eb42ee752 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:59.834082 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:59.840810 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:24:59.934389 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Made reservation on behalf of 1db248e02dac49bf8688658eb42ee752 for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:24:59.937346 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:59.950012 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:24:59.964950 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:24:59.968993 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Usage tracker for resource:security_group_rule and tenant:1db248e02dac49bf8688658eb42ee752 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:24:59.971841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:24:59.977795 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:00.024362 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 req-9031b4d1-c178-4177-a72d-ad6f24fb7469 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:00.025890 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 req-9031b4d1-c178-4177-a72d-ad6f24fb7469 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0852640
May 28 14:25:00.033283 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-18c5365a-0238-4de6-8bd5-3260c72e39b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:00.070548 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:00.078522 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bdb12165-4f51-4f4f-95aa-12c22b69ad85 req-53680b04-2a5b-4eb4-a098-cd7579f08ca7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417209
May 28 14:25:00.164368 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:00.168643 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-23bb65df-7d34-4de8-a835-89500ae9fb18 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:00.196086 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] vlan segment allocate from pool success with {'vlan_id': 882, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:25:00.205529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9dbfc65b-288f-40c1-b875-e07271ac76fb,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:00.208686 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:00.211616 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:00.211962 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Added segment dda0b714-8a1c-44e0-bb8a-72b17cf406ad of type vlan for network 8023cc33-82ed-49b2-a8e8-69839a1ff66e
May 28 14:25:00.240612 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:00.359581 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:00.360967 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:00.361550 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:00.365288 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:00.464588 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Pushing event updated for resources: {'Network': ['ID=8023cc33-82ed-49b2-a8e8-69839a1ff66e,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:00.467294 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:00.475166 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 8023cc33-82ed-49b2-a8e8-69839a1ff66e details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:25:00.536839 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-26695b92-e4f2-4151-a413-c6cce1260376 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.8309858
May 28 14:25:00.539406 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33680) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:00.545222 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Request body: {'subnet': {'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-87445087-subnet', 'tenant_id': '1db248e02dac49bf8688658eb42ee752', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:00.550977 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:00.554892 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Usage tracker for resource:subnet and tenant:1db248e02dac49bf8688658eb42ee752 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:00.558281 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:00.564158 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:00.639379 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Made reservation on behalf of 1db248e02dac49bf8688658eb42ee752 for: {'subnet': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:25:00.644122 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1808138'] for subnet, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:00.882001 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d1b3a9-ca3a-4e27-8252-2907d7540619 req-5fa33bc3-20c5-44b3-805e-970bcc439b67 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:00.883465 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-42d1b3a9-ca3a-4e27-8252-2907d7540619 req-5fa33bc3-20c5-44b3-805e-970bcc439b67 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 944 time: 0.1754177
May 28 14:25:00.960302 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-42d1b3a9-ca3a-4e27-8252-2907d7540619 req-8d25029f-a4a7-4d3f-875c-30efdf4da63a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0694137
May 28 14:25:01.269636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1635813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1808156'] for subnet, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:01.276240 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8ddc9dba-7f63-4adc-8c45-b95479ad1a90 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:01.289510 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33704) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:01.355073 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Pushing event updated for resources: {'Subnet': ['ID=00f80d27-adb3-4b05-9355-ad0adc3a3490,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:01.365000 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:01.368335 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Checking segment: {'id': 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:01.368806 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Network hostable DHCP agents. Network: 8023cc33-82ed-49b2-a8e8-69839a1ff66e, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92695) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:25:01.378118 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e47263a0-c4ab-490e-9af1-e08b58b2d102 req-03aec665-a3e5-47d7-bd15-47089354f8f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:01.379613 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e47263a0-c4ab-490e-9af1-e08b58b2d102 req-03aec665-a3e5-47d7-bd15-47089354f8f3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1818993
May 28 14:25:01.409496 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:01.424181 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:01.428317 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Usage tracker for resource:security_group_rule and tenant:7e5df45c2fea4975b3cb6f6754a1c57b is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:01.431389 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:01.437884 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:01.504651 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e47263a0-c4ab-490e-9af1-e08b58b2d102 req-e0ec90af-1e0a-4447-8596-688a048fefb4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1181724
May 28 14:25:01.534258 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:01.569864 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Network 8023cc33-82ed-49b2-a8e8-69839a1ff66e is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92695) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:25:01.656167 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:01.663420 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a64ab433-f801-45fb-8a60-e1e24013589a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:01.695721 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 8023cc33-82ed-49b2-a8e8-69839a1ff66e) {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:01.705758 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fd4cdb0-1a50-470d-a90a-9a748a332dc7 None None] Network 8023cc33-82ed-49b2-a8e8-69839a1ff66e requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:25:01.706474 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43e72794-c01e-42bd-acb9-2aa29da7f3d3,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:01.712113 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:01.712113 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:01.713502 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=7e5df45c2fea4975b3cb6f6754a1c57b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4229534
May 28 14:25:01.714472 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:01.714915 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33710) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:01.773678 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-00aae515-f9a2-4210-9b38-b0c86b6d9ea1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:01.803519 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-00aae515-f9a2-4210-9b38-b0c86b6d9ea1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:01.849795 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-78c3f34f-e6c1-48bc-b312-bd0d3106b071 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 1.3083389
May 28 14:25:01.904063 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb073352-f9af-4bf7-be54-7e6f03a810c2 None None] Network 8023cc33-82ed-49b2-a8e8-69839a1ff66e requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:25:01.953658 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-00aae515-f9a2-4210-9b38-b0c86b6d9ea1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:01.959418 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4564d871-41b8-4475-b537-a4fa8e5cc01f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:01.973214 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00aae515-f9a2-4210-9b38-b0c86b6d9ea1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43e72794-c01e-42bd-acb9-2aa29da7f3d3,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:01.975720 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-00aae515-f9a2-4210-9b38-b0c86b6d9ea1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:01.978352 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-00aae515-f9a2-4210-9b38-b0c86b6d9ea1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:01.983888 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-00aae515-f9a2-4210-9b38-b0c86b6d9ea1 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/43e72794-c01e-42bd-acb9-2aa29da7f3d3 HTTP/1.1" status: 204  len: 168 time: 0.2676666
May 28 14:25:02.217738 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 req-9aa0910f-d08e-4149-baad-7a3a0073955f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:02.219400 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 req-9aa0910f-d08e-4149-baad-7a3a0073955f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 944 time: 0.0927062
May 28 14:25:02.265936 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ac7f6d5e-4301-4453-b0e8-e6dcd9c2bd84 req-b9320920-e1a1-409f-8e64-803ac2167bfd tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405297
May 28 14:25:02.524373 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:02.543893 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:25:02.552970 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-ad2e4fa8-0c95-46be-90d7-57fe37b9be35 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:02.623816 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 3c609de4-4752-48b6-81cf-9335e2a7a542 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:02.697404 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3be309-04e8-4484-a53d-2a2efbdb810f req-ead8667f-ab0d-4222-9127-bd61d5e074d5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:02.698883 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5c3be309-04e8-4484-a53d-2a2efbdb810f req-ead8667f-ab0d-4222-9127-bd61d5e074d5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0842030
May 28 14:25:02.755524 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5c3be309-04e8-4484-a53d-2a2efbdb810f req-3c830ec9-8c06-4419-890a-9acf4dab6bbb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0506237
May 28 14:25:02.783510 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33734) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:02.792939 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 3c609de4-4752-48b6-81cf-9335e2a7a542 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:02.799496 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 3c609de4-4752-48b6-81cf-9335e2a7a542 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:02.799955 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:02.801146 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:02.819905 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:02.823933 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Usage tracker for resource:security_group_rule and tenant:59f4fdbe1aba48b1a17300ccf9c53e60 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:02.827729 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:02.833048 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:02.920925 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:02.944775 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:02.977584 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3a422bf7-82c2-409e-a573-929842d0cff3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3c609de4-4752-48b6-81cf-9335e2a7a542'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:25:02.999533 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 3c609de4-4752-48b6-81cf-9335e2a7a542, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=3c609de4-4752-48b6-81cf-9335e2a7a542,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:03.031128 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3a422bf7-82c2-409e-a573-929842d0cff3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3c609de4-4752-48b6-81cf-9335e2a7a542', 'code': 200}
May 28 14:25:03.061614 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:03.070914 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ebf78d59-c190-4098-985e-d75338f36307 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:03.093468 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:03.098116 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-fe7ab1d9-9da1-41b4-ab83-f8e1422fb6d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:03.110159 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=59f4fdbe1aba48b1a17300ccf9c53e60&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3255143
May 28 14:25:03.113248 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33746) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:03.121404 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3343669b-e96f-40e8-8cd9-a902ea0ce470,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:03.124609 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:03.189554 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=3c609de4-4752-48b6-81cf-9335e2a7a542,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:03.192786 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:03.199364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c8809e8c-976c-4cd9-9adf-100ddeb5e0bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:03.226112 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c8809e8c-976c-4cd9-9adf-100ddeb5e0bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:03.370180 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c8809e8c-976c-4cd9-9adf-100ddeb5e0bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:03.376847 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b1a60527-d284-4357-8c2f-f1d5913c87d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:03.391494 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8809e8c-976c-4cd9-9adf-100ddeb5e0bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3343669b-e96f-40e8-8cd9-a902ea0ce470,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:03.394589 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c8809e8c-976c-4cd9-9adf-100ddeb5e0bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:03.401531 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c8809e8c-976c-4cd9-9adf-100ddeb5e0bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:03.401531 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c8809e8c-976c-4cd9-9adf-100ddeb5e0bf admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/3343669b-e96f-40e8-8cd9-a902ea0ce470 HTTP/1.1" status: 204  len: 168 time: 0.2850809
May 28 14:25:03.470893 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f22b762-c85b-425b-a297-9d81a695fe56 req-bc579e92-e2fa-40f8-b4a0-8fb428f95160 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:03.472466 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6f22b762-c85b-425b-a297-9d81a695fe56 req-bc579e92-e2fa-40f8-b4a0-8fb428f95160 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 945 time: 0.0972595
May 28 14:25:03.531223 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6f22b762-c85b-425b-a297-9d81a695fe56 req-fee415dd-ec9a-4f5b-9e44-0b55ff506601 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0506682
May 28 14:25:03.557274 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfe05d1d-2292-4326-8e0a-bbcd47b44336 req-c8c71273-b590-47c3-afc7-af12b011cd57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:03.558754 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dfe05d1d-2292-4326-8e0a-bbcd47b44336 req-c8c71273-b590-47c3-afc7-af12b011cd57 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 1098 time: 0.0812757
May 28 14:25:03.602234 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dfe05d1d-2292-4326-8e0a-bbcd47b44336 req-ab935029-8241-4be5-9506-6ae7a66ff069 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0351841
May 28 14:25:03.724573 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:03.935397 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238f6bbb-2f4d-4262-9946-ee32a620b05e req-3156234b-3780-47fd-b3fd-b64545da9752 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:03.936879 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-238f6bbb-2f4d-4262-9946-ee32a620b05e req-3156234b-3780-47fd-b3fd-b64545da9752 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0808430
May 28 14:25:03.982441 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-238f6bbb-2f4d-4262-9946-ee32a620b05e req-d3eb2555-0735-40a9-b879-c4edd83fdad0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396960
May 28 14:25:04.233255 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33766) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:04.316586 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:04.332604 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:04.338673 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Usage tracker for resource:security_group_rule and tenant:265feb6f17ab48878c2232c4d2bb2628 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:04.341700 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:04.348463 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:04.432293 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:04.498798 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df11c95-3983-45d3-8ad7-a37639469791 req-75855a26-7c13-4005-a997-0b3fb8da1a61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:04.500504 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7df11c95-3983-45d3-8ad7-a37639469791 req-75855a26-7c13-4005-a997-0b3fb8da1a61 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1098 time: 0.0723319
May 28 14:25:04.542590 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7df11c95-3983-45d3-8ad7-a37639469791 req-c9b31408-9930-459a-885c-efa01e048ff6 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0355597
May 28 14:25:04.575493 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:04.583129 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ee7ae5a5-3408-4281-92d8-4a1f1e279f65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:04.630568 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=265feb6f17ab48878c2232c4d2bb2628&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3955696
May 28 14:25:04.631720 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d938401-3470-4207-b78a-0d0a6f1c4a7d,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:04.633178 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33776) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:04.636124 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:04.754166 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a49b0168-ea5c-4066-87ee-0ebc096796d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:04.789913 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e8764d-49c9-49ae-97a2-dcc102df6617 req-16ba1629-be7d-4f7d-b005-03943bf97a71 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:04.791408 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-01e8764d-49c9-49ae-97a2-dcc102df6617 req-16ba1629-be7d-4f7d-b005-03943bf97a71 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 945 time: 0.1413901
May 28 14:25:04.796573 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a49b0168-ea5c-4066-87ee-0ebc096796d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:04.868203 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-01e8764d-49c9-49ae-97a2-dcc102df6617 req-03f29d38-6f68-4012-a571-6192056f7d6a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0647225
May 28 14:25:04.993500 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a49b0168-ea5c-4066-87ee-0ebc096796d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:04.997397 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c8809e8c-976c-4cd9-9adf-100ddeb5e0bf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:05.008767 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a49b0168-ea5c-4066-87ee-0ebc096796d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d938401-3470-4207-b78a-0d0a6f1c4a7d,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:05.012470 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a49b0168-ea5c-4066-87ee-0ebc096796d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:05.016058 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a49b0168-ea5c-4066-87ee-0ebc096796d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:05.017300 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-a49b0168-ea5c-4066-87ee-0ebc096796d4 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/2d938401-3470-4207-b78a-0d0a6f1c4a7d HTTP/1.1" status: 204  len: 168 time: 0.3830030
May 28 14:25:05.180997 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31410678-9518-46f2-aded-fc8a88a10714 req-0f279b56-acbf-4c0c-aef8-5082d0cc52b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:05.182485 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-31410678-9518-46f2-aded-fc8a88a10714 req-0f279b56-acbf-4c0c-aef8-5082d0cc52b7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0873775
May 28 14:25:05.229160 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-31410678-9518-46f2-aded-fc8a88a10714 req-c1ef85b1-1a37-4003-ac38-75ec538ed3d8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406208
May 28 14:25:05.302373 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:05.623541 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-bbc14f66-e67d-4883-bb23-ad68d6b3ddcd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:05.630130 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-bbc14f66-e67d-4883-bb23-ad68d6b3ddcd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/networks?id=8023cc33-82ed-49b2-a8e8-69839a1ff66e HTTP/1.1" status: 200  len: 812 time: 0.1527736
May 28 14:25:05.641471 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-a8deb762-e418-4052-b593-4fdf43ec1134 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/quotas/1db248e02dac49bf8688658eb42ee752 HTTP/1.1" status: 200  len: 375 time: 0.0097990
May 28 14:25:05.693812 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-1491eb08-adfc-42d8-981a-4dcb9ab66866 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=1db248e02dac49bf8688658eb42ee752&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0469007
May 28 14:25:05.849781 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-96476e3c-9496-46de-afae-e19b536787e7 service neutron] 10.222.0.59 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1490195
May 28 14:25:05.995785 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-e4dbf07c-d51c-4216-ba54-d025f21ed92d service neutron] 10.222.0.59 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1401041
May 28 14:25:06.080866 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 req-bdba63f0-368e-4194-8dc4-fb7f57944c80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:06.082318 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 req-bdba63f0-368e-4194-8dc4-fb7f57944c80 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 945 time: 0.0948055
May 28 14:25:06.132652 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a8ed691b-f27d-47e3-bc90-7e74aafd2c43 req-92f1967d-ba30-41e1-bdd0-7fb7740f2951 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412283
May 28 14:25:06.505712 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2b403538-ef83-4c3d-878f-faa229d4947e req-64b33f6b-4a07-49c7-9f46-bb91a01bf77b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0609415
May 28 14:25:06.561862 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053ded33-cc33-48bf-a144-2d95f250e6ca req-a768e1e3-6d64-4247-a227-2b049a382c1a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:06.563435 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-053ded33-cc33-48bf-a144-2d95f250e6ca req-a768e1e3-6d64-4247-a227-2b049a382c1a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1106558
May 28 14:25:06.595273 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33834) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:06.642367 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-053ded33-cc33-48bf-a144-2d95f250e6ca req-5462d128-9756-489d-898c-e798fc862897 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0682435
May 28 14:25:06.727843 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1362644589-network', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:06.733962 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:06.740680 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Usage tracker for resource:network and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:06.743846 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:06.750005 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:06.878892 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Made reservation on behalf of c6d2d25991f04f00a48394ddbeec688e for: {'network': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:25:06.881174 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:06.894428 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:06.909511 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:06.913713 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Usage tracker for resource:security_group_rule and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:06.916649 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:06.923169 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:07.009599 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:07.119957 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:07.122974 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9084d3fb-9fee-4ccc-8107-38ddfdbdb503 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:07.156656 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] vlan segment allocate from pool success with {'vlan_id': 867, 'physical_network': 'physnet1'}  {{(pid=92694) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:25:07.161849 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d0efde2-fb63-41f2-837f-f88e56c16cc3,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:07.165541 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:07.169348 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:07.169845 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.segments_db [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Added segment 2adec342-3afa-48b6-acc6-9f4a9ce2773e of type vlan for network 89b0ce92-0695-466c-b1ce-9a354ecba633
May 28 14:25:07.197941 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:07.345898 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 req-aa8eba0f-943e-40db-8540-c25e6b22bc52 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:07.347388 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 req-aa8eba0f-943e-40db-8540-c25e6b22bc52 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 945 time: 0.0830181
May 28 14:25:07.375037 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:07.377711 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:07.378397 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:07.391794 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:07.429041 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8ca52fa9-c53f-45e5-9689-a82bb440ff83 req-99cacf1e-fc81-4b69-88a3-61891f97f1ce tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0759261
May 28 14:25:07.517216 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Pushing event updated for resources: {'Network': ['ID=89b0ce92-0695-466c-b1ce-9a354ecba633,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:07.528524 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:07.528925 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:25:07.605521 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fe52c6f9-0844-40dd-b754-a4fec0fb4775 req-1c44f662-0a23-400c-9a48-7e6a0ce289cd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0455959
May 28 14:25:07.697101 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 1.1005855
May 28 14:25:07.699835 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33866) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:07.707253 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Request body: {'subnet': {'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1362644589-subnet', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:07.712782 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:07.716922 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Usage tracker for resource:subnet and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:07.720721 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:07.726828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:07.836854 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a50880eb-c052-46a9-9265-322535a04070 req-b2f197ea-779b-429a-b4dc-7c5219b62fcc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:07.838424 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a50880eb-c052-46a9-9265-322535a04070 req-b2f197ea-779b-429a-b4dc-7c5219b62fcc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0866241
May 28 14:25:07.844834 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Made reservation on behalf of c6d2d25991f04f00a48394ddbeec688e for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:25:07.847246 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3521847'] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:07.894229 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a50880eb-c052-46a9-9265-322535a04070 req-6d874c8a-ff54-44bc-b1f3-672899a0b504 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457075
May 28 14:25:08.524654 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483451', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3521825'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:08.538656 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-27a06252-28df-4149-bfc2-60bfb0b18095 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:08.660182 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Pushing event updated for resources: {'Subnet': ['ID=a63662e1-f44d-44cd-98c9-2b87dba66278,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:08.662969 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:08.667160 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Checking segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:08.667501 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Network hostable DHCP agents. Network: 89b0ce92-0695-466c-b1ce-9a354ecba633, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:25:08.791439 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-304e7444-7ea5-49a8-a2c2-45b64257feeb req-32ad2a60-adb4-470c-872e-66db3730c94b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0437899
May 28 14:25:08.815831 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:25:08.983794 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 89b0ce92-0695-466c-b1ce-9a354ecba633) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:08.993215 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05232c60-6be1-4ea3-92b0-06ffa9d51453 None None] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:25:09.088947 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:09.090788 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:09.131511 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 req-4805fe11-0775-4a72-bc83-2a99719933c1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:09.133110 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 req-4805fe11-0775-4a72-bc83-2a99719933c1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1885443
May 28 14:25:09.171808 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-d9642fe3-39b4-4bb5-b5e5-eaf5b784b150 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:09.174211 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-d9642fe3-39b4-4bb5-b5e5-eaf5b784b150 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 1098 time: 0.1098096
May 28 14:25:09.193075 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e1ff5428-8f4f-4d59-b516-68d4c3c314e2 req-58b0e5d2-8a15-4e67-acc3-49c1b11831f0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0538733
May 28 14:25:09.222220 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-39873fb9-1c2d-4acf-8bb3-3175f725260e admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 1.5210948
May 28 14:25:09.225028 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33898) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:09.234592 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:09.241106 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:09.246917 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Usage tracker for resource:router and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:09.251101 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:09.258038 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:09.283421 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-89b0ce92-0695-466c-b1ce-9a354ecba633', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:25:09.283421 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:09.395512 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:09.395512 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:09.415773 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-87fcdbb3-56c3-49dd-9090-cc1d1e628eb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:09.417533 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-87fcdbb3-56c3-49dd-9090-cc1d1e628eb9 service neutron] 10.222.0.90 "GET /v2.0/networks?id=1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 200  len: 920 time: 0.2356725
May 28 14:25:09.424537 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:09.489129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Allocated IP 172.20.0.2 (89b0ce92-0695-466c-b1ce-9a354ecba633/a63662e1-f44d-44cd-98c9-2b87dba66278/7b71eb62-5ea3-47af-aa59-795dd8ba09b9) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:09.532319 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-33b9e215-50d1-4ada-b40e-9a80f4f6aea9 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84 HTTP/1.1" status: 200  len: 217 time: 0.1056247
May 28 14:25:09.599919 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-34e7f802-26db-4cec-95f4-16da7cc5e692 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:09.601581 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-34e7f802-26db-4cec-95f4-16da7cc5e692 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 200  len: 859 time: 0.0605905
May 28 14:25:09.659435 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-86556e5b-eb87-4dac-9eb9-c2f6b8759714 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=1145a91e-035d-40fe-813b-06d960bbe8ad&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0486028
May 28 14:25:09.710968 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:09.722385 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Transition to ACTIVE for port object 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:09.742797 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Transition to ACTIVE for port object 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:09.817987 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-66b8c36d-5e38-4cf7-b699-1491b0e8c74e service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1501045
May 28 14:25:09.854992 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:09.859876 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:09.940930 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Pushing event updated for resources: {'Port': ['ID=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:09.944991 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:09.957391 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:09.960633 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:09.962644 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:09.966225 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:10.002639 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-02b5c22f-b1cc-4ef6-9d49-69c83f71fb0f req-39b2ef18-663b-4e97-a9c5-957a7058288d service neutron] 10.222.0.90 "GET /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1725936
May 28 14:25:10.040130 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-99a89f90-e559-41ee-929e-7f869b0ab4ec req-ad4430e7-0f1a-4ddf-9dd6-0ccaaa36277a tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0700867
May 28 14:25:10.068759 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Attempting to bind port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:10.069437 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Attempting to bind port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:10.069549 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Attempting to bind port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 on network 89b0ce92-0695-466c-b1ce-9a354ecba633 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:10.079132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 25, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:10.079132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Checking segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:10.079132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:10.079132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Bound using segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:10.079132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Bound port: 7b71eb62-5ea3-47af-aa59-795dd8ba09b9, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:10.079132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:10.176502 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] For port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:10.179689 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] For port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:10.251803 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:10.260243 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:10.289520 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608ae2ae-3364-4a52-9869-66844582551f req-ed94771d-b284-4f94-a59c-f7acb32ae952 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:10.297880 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-608ae2ae-3364-4a52-9869-66844582551f req-ed94771d-b284-4f94-a59c-f7acb32ae952 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 945 time: 0.1321664
May 28 14:25:10.344814 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Pushing event updated for resources: {'Port': ['ID=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:10.349592 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:10.461848 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-608ae2ae-3364-4a52-9869-66844582551f req-25ced360-e128-4782-aa13-f9c945144706 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1627140
May 28 14:25:10.595239 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 req-3e2407e9-2935-488e-9e8f-7f5e83d12279 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:10.596903 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 req-3e2407e9-2935-488e-9e8f-7f5e83d12279 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.2358780
May 28 14:25:10.604283 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-f0e4a21a-eb15-4933-8f19-23bed339970c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:10.605016 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-f0e4a21a-eb15-4933-8f19-23bed339970c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Synchronizing usage tracker for tenant:1db248e02dac49bf8688658eb42ee752 on resource:network {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:25:10.635641 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:10.682048 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:10.697325 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-abab8103-cbc7-4e44-b6a7-da0a2024d7c5 req-5f1cbf91-5ccc-4856-b484-74a1ca1a8ce4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0840895
May 28 14:25:10.765063 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-f0e4a21a-eb15-4933-8f19-23bed339970c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Unset dirty status for tenant:1db248e02dac49bf8688658eb42ee752 on resource:network {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:25:10.766404 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-f0e4a21a-eb15-4933-8f19-23bed339970c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.90 "GET /v2.0/networks?id=8023cc33-82ed-49b2-a8e8-69839a1ff66e HTTP/1.1" status: 200  len: 812 time: 0.5456970
May 28 14:25:10.792006 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Request body: {'port': {'device_id': '031d9ce3-9559-48b6-b92f-47ac210b74be', 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e', 'admin_state_up': True, 'tenant_id': '1db248e02dac49bf8688658eb42ee752'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:10.971103 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:10.974793 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Allocated IP 172.27.3.133 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/f304788f-9f81-4703-80c4-593b1df6747b) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:11.050641 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:11.054911 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Usage tracker for resource:port and tenant:1db248e02dac49bf8688658eb42ee752 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:11.070218 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:11.076905 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:11.152961 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:11.204084 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:11.211935 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4856db7-7c40-4450-8662-8a3354296657 req-788c70eb-892c-49b7-8830-5a74b892d707 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0431077
May 28 14:25:11.215909 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Made reservation on behalf of 1db248e02dac49bf8688658eb42ee752 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:25:11.219822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:11.325516 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:11.331382 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:11.398757 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:11.401870 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:11.406532 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:11.407095 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Allocated IP 172.20.0.10 (8023cc33-82ed-49b2-a8e8-69839a1ff66e/00f80d27-adb3-4b05-9355-ad0adc3a3490/15e73ba1-bc57-49ac-bae9-9906c3fe9522) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:11.447990 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Pushing event updated for resources: {'Port': ['ID=f304788f-9f81-4703-80c4-593b1df6747b,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:11.464562 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:11.657768 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:11.677611 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fce09be7-7381-4877-8556-8bc0fb6b9ad4 None None] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:25:11.694337 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33944) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:11.788546 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:11.796448 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:11.884104 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a4ce2a87-c9ea-4e61-ae99-c84d47d79f8a None None] Provisioning for port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:11.894510 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a4ce2a87-c9ea-4e61-ae99-c84d47d79f8a None None] Provisioning complete for port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:11.895074 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a4ce2a87-c9ea-4e61-ae99-c84d47d79f8a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:11.957242 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Network 8023cc33-82ed-49b2-a8e8-69839a1ff66e is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:11.963528 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:11.982830 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62cbb353-4dfc-45cf-a030-3cfa980f762b req-17380ba3-e5d1-4cbb-8a15-d2c6219bf4d5 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:12.006113 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-62cbb353-4dfc-45cf-a030-3cfa980f762b req-17380ba3-e5d1-4cbb-8a15-d2c6219bf4d5 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 945 time: 0.2024970
May 28 14:25:12.008651 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.027452 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:12.034945 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-62cbb353-4dfc-45cf-a030-3cfa980f762b req-1d439914-f190-466d-bae8-000bfd71e667 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442357
May 28 14:25:12.091009 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:12.095968 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Pushing event updated for resources: {'Port': ['ID=15e73ba1-bc57-49ac-bae9-9906c3fe9522,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:12.102143 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.306s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:12.108334 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a4ce2a87-c9ea-4e61-ae99-c84d47d79f8a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.112004 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Usage tracker for resource:security_group_rule and tenant:d3f83fb534094b359d8019b7c7410980 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:12.117147 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:12.130708 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:12.131515 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.137669 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:12.150295 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-a4ce2a87-c9ea-4e61-ae99-c84d47d79f8a None None] For port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:12.182500 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e081de4-ab04-4a24-a111-d0e5763c8f64 req-37ddf19d-bb4c-4012-96ce-2207a7e93fad tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:12.188093 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4e081de4-ab04-4a24-a111-d0e5763c8f64 req-37ddf19d-bb4c-4012-96ce-2207a7e93fad tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.2476246
May 28 14:25:12.249282 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4e081de4-ab04-4a24-a111-d0e5763c8f64 req-6046c752-16d3-4a88-b55a-24a0150ee2ca tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0571017
May 28 14:25:12.279615 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a4ce2a87-c9ea-4e61-ae99-c84d47d79f8a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.282948 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.4972854
May 28 14:25:12.290046 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:12.313317 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Request body: {'port': {'device_id': '031d9ce3-9559-48b6-b92f-47ac210b74be', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:12.368404 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.393611 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ce2a87-c9ea-4e61-ae99-c84d47d79f8a None None] Pushing event updated for resources: {'Port': ['ID=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:12.406198 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-a4ce2a87-c9ea-4e61-ae99-c84d47d79f8a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:12.422196 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-eac4ede9-3550-4b05-8131-aaa23edb4943 None None] Provisioning complete for port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:12.422707 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-eac4ede9-3550-4b05-8131-aaa23edb4943 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.611636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.635785 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-a6a4b7af-a3fe-4f4d-bb60-0e7030f51d83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:12.637232 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-a6a4b7af-a3fe-4f4d-bb60-0e7030f51d83 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.90 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 945 time: 0.2539439
May 28 14:25:12.648697 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.681280 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd req-d19fb9bd-afb6-4fec-a815-2c11853f4fcb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:12.682770 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd req-d19fb9bd-afb6-4fec-a815-2c11853f4fcb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 932 time: 0.2455373
May 28 14:25:12.743201 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.754475 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-2188ea2d-f4b9-4855-aad2-48654b92c9d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:12.818227 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ee55ecff-d17f-4435-99e3-0ad1ecf408cd req-bbddd186-a91e-480b-8979-40b95eb1f3e5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1265883
May 28 14:25:12.822643 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:12.845006 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:12.897871 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6037ddea-ff2d-4556-b685-492fc7ba3473,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:12.904913 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=d3f83fb534094b359d8019b7c7410980&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2089157
May 28 14:25:12.906498 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:12.913738 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 33960) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:12.914694 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:12.915081 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.241438 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5923dc35-a393-426a-81da-e1e551a65ca7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.256312 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Router 0cb62432-a4fe-4ba8-9099-f616594e4211 is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92694) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:25:13.268267 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Deleting port 3c609de4-4752-48b6-81cf-9335e2a7a542 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:25:13.268601 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.382582 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5923dc35-a393-426a-81da-e1e551a65ca7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.500025 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:25:13.510561 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Sync routers for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:25:13.525841 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:25:13.526764 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba281a2e0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:13.588707 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a242cfe2-964f-4063-9cc4-89564328200c req-682cb69a-3d50-492c-aa13-c775a7fe18e2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:13.590293 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a242cfe2-964f-4063-9cc4-89564328200c req-682cb69a-3d50-492c-aa13-c775a7fe18e2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 945 time: 0.4268692
May 28 14:25:13.629233 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 req-f96cbc3c-4213-4771-96ae-26fa9df7e8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:13.631205 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 req-f96cbc3c-4213-4771-96ae-26fa9df7e8ec tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1287663
May 28 14:25:13.636403 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 15e73ba1-bc57-49ac-bae9-9906c3fe9522 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:25:13.656333 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.659755 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] For port 3c609de4-4752-48b6-81cf-9335e2a7a542, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=3c609de4-4752-48b6-81cf-9335e2a7a542,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:13.660109 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.716309 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c9dc4ace-d6ef-4732-8f22-442f45ecdb24 req-47e8d409-8486-4365-ace5-cb3c4471fd62 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0775261
May 28 14:25:13.716749 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:25:13.722867 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Notify callbacks [] for router, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.724295 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 4.4978819
May 28 14:25:13.728024 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 33974) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:13.824467 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a242cfe2-964f-4063-9cc4-89564328200c req-afae8b05-8ebb-49c0-9af5-e4ff11dff306 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2228246
May 28 14:25:13.836540 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling delete_port for 3c609de4-4752-48b6-81cf-9335e2a7a542 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:25:13.843810 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Transition to ACTIVE for port object 15e73ba1-bc57-49ac-bae9-9906c3fe9522 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:13.848185 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5923dc35-a393-426a-81da-e1e551a65ca7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.858475 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8c24946e-5e44-4470-851d-123b3c822f22 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:13.893724 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5923dc35-a393-426a-81da-e1e551a65ca7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6037ddea-ff2d-4556-b685-492fc7ba3473,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:13.905540 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5923dc35-a393-426a-81da-e1e551a65ca7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:13.915651 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5923dc35-a393-426a-81da-e1e551a65ca7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.917243 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5923dc35-a393-426a-81da-e1e551a65ca7 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/6037ddea-ff2d-4556-b685-492fc7ba3473 HTTP/1.1" status: 204  len: 168 time: 1.0025139
May 28 14:25:13.947306 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:13.961345 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:14.106389 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba281a2e0>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:11Z', 'revision_number': 3, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:14.110606 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Checking router: 0cb62432-a4fe-4ba8-9099-f616594e4211 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:25:14.111003 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Updating router 0cb62432-a4fe-4ba8-9099-f616594e4211 port f304788f-9f81-4703-80c4-593b1df6747b binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:25:14.178509 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:14.200844 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Pushing event updated for resources: {'Port': ['ID=15e73ba1-bc57-49ac-bae9-9906c3fe9522,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:14.205289 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:14.263880 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 req-c7660d57-9d80-4187-844c-7b022481baab tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:14.266783 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 req-c7660d57-9d80-4187-844c-7b022481baab tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 944 time: 0.2627642
May 28 14:25:14.346178 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Attempting to bind port 15e73ba1-bc57-49ac-bae9-9906c3fe9522 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:14.346802 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Attempting to bind port 15e73ba1-bc57-49ac-bae9-9906c3fe9522 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:14.347126 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Attempting to bind port 15e73ba1-bc57-49ac-bae9-9906c3fe9522 on network 8023cc33-82ed-49b2-a8e8-69839a1ff66e {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:14.357656 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Port 15e73ba1-bc57-49ac-bae9-9906c3fe9522 on network 8023cc33-82ed-49b2-a8e8-69839a1ff66e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:25:14.358014 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Attempting to bind port 15e73ba1-bc57-49ac-bae9-9906c3fe9522 on network 8023cc33-82ed-49b2-a8e8-69839a1ff66e {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:14.367521 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 24, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:14.367887 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Checking segment: {'id': 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:14.368340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Bound using segment: {'id': 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:14.368798 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Bound port: 15e73ba1-bc57-49ac-bae9-9906c3fe9522, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:14.369149 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:14.403989 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bfd3f74e-1cb9-4f85-893c-52fbdbca3f12 req-b0d40188-58a7-4c6b-9fce-ba3d800d7a84 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1212935
May 28 14:25:14.500358 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:14.508022 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-d6d5fc35-be89-4c88-8d64-e65a7a62f64b tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:14.558466 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Pushing event deleted for resources: {'Port': ['ID=3c609de4-4752-48b6-81cf-9335e2a7a542,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:14.561691 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] For port 15e73ba1-bc57-49ac-bae9-9906c3fe9522, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:14.564944 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:14.627619 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] For port 15e73ba1-bc57-49ac-bae9-9906c3fe9522, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=15e73ba1-bc57-49ac-bae9-9906c3fe9522,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:14.653353 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:14.668712 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Transition to ACTIVE for port object f304788f-9f81-4703-80c4-593b1df6747b will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:14.668879 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 3c609de4-4752-48b6-81cf-9335e2a7a542 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:25:14.683459 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] No DVR routers for this DVR port 3c609de4-4752-48b6-81cf-9335e2a7a542 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:25:14.687104 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:14.693079 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3a422bf7-82c2-409e-a573-929842d0cff3', 'name': 'network-vif-deleted', 'tag': '3c609de4-4752-48b6-81cf-9335e2a7a542'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:25:14.722170 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 3c609de4-4752-48b6-81cf-9335e2a7a542 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:25:14.725828 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:14.729648 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 3c609de4-4752-48b6-81cf-9335e2a7a542 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:25:14.734890 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:14.765693 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:14.793336 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-8fabec57-b683-4ddc-a1b3-2c8b5121b9d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:14.833485 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3a422bf7-82c2-409e-a573-929842d0cff3', 'name': 'network-vif-deleted', 'tag': '3c609de4-4752-48b6-81cf-9335e2a7a542', 'status': 'completed', 'code': 200}
May 28 14:25:14.839484 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:14.840888 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:14.842561 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] 10.222.0.90 "PUT /v2.0/ports/15e73ba1-bc57-49ac-bae9-9906c3fe9522 HTTP/1.1" status: 200  len: 1094 time: 2.5444558
May 28 14:25:14.858903 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5cd69399-4a70-40e8-af47-62e96d509c42 req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.90 "DELETE /v2.0/ports/3c609de4-4752-48b6-81cf-9335e2a7a542 HTTP/1.1" status: 204  len: 173 time: 2.2088339
May 28 14:25:14.997112 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Attempting to bind port f304788f-9f81-4703-80c4-593b1df6747b on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:14.998074 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Attempting to bind port f304788f-9f81-4703-80c4-593b1df6747b by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:14.998702 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Attempting to bind port f304788f-9f81-4703-80c4-593b1df6747b on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:15.003176 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:15.010177 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Pushing event updated for resources: {'Port': ['ID=f304788f-9f81-4703-80c4-593b1df6747b,revision_number=2']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:15.019135 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 25, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:15.019836 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:15.020748 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:15.021648 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:15.022651 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Bound port: f304788f-9f81-4703-80c4-593b1df6747b, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:15.023539 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:15.117632 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.118264 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.118870 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.119463 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.120085 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.120692 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.121286 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.121890 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.122516 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.123114 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.124447 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.125053 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:15.125702 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Pushing event updated for resources: {'Port': ['ID=15e73ba1-bc57-49ac-bae9-9906c3fe9522,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:15.140429 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.405s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:15.141262 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.349s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:15.156325 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8466ac77-da98-44d4-9a5b-1af347de1ec2 req-c63de8ab-03b4-4c35-9987-c64ea85df88e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:15.158064 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8466ac77-da98-44d4-9a5b-1af347de1ec2 req-c63de8ab-03b4-4c35-9987-c64ea85df88e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.2771213
May 28 14:25:15.170183 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-eac3ae4c-8a3a-425a-9ca7-fcfd4131e57c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:15.171841 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-eac3ae4c-8a3a-425a-9ca7-fcfd4131e57c service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=1db248e02dac49bf8688658eb42ee752&device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 1097 time: 0.1926029
May 28 14:25:15.196757 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] For port f304788f-9f81-4703-80c4-593b1df6747b, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:15.205588 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] For port f304788f-9f81-4703-80c4-593b1df6747b, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f304788f-9f81-4703-80c4-593b1df6747b,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:15.288569 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6f0af5a9-67bb-46b0-bf5f-943fabd85e2a req-cf5d942f-8e91-4c88-a033-2c03463c1de8 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=3a422bf7-82c2-409e-a573-929842d0cff3 HTTP/1.1" status: 200  len: 210 time: 0.2135854
May 28 14:25:15.291763 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-759596d8-0bcd-41e2-bb68-5a48aa588807 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=15e73ba1-bc57-49ac-bae9-9906c3fe9522 HTTP/1.1" status: 200  len: 217 time: 0.1063149
May 28 14:25:15.342752 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:15.354293 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-8fabec57-b683-4ddc-a1b3-2c8b5121b9d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:15.439697 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:25:15.440359 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba281a2e0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:15.469614 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8466ac77-da98-44d4-9a5b-1af347de1ec2 req-18e8fd74-3a57-40b2-84ac-75d397bed2a3 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3017840
May 28 14:25:15.472933 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Allocated IP 172.20.0.1 (89b0ce92-0695-466c-b1ce-9a354ecba633/a63662e1-f44d-44cd-98c9-2b87dba66278/dbcc346c-8a01-43e6-927e-2d168febed7c) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:15.498375 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-18ee92af-51e2-49f4-a603-8e824ebb2c7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:15.500108 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-18ee92af-51e2-49f4-a603-8e824ebb2c7f service neutron] 10.222.0.90 "GET /v2.0/subnets?id=00f80d27-adb3-4b05-9355-ad0adc3a3490 HTTP/1.1" status: 200  len: 852 time: 0.1798227
May 28 14:25:15.560495 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-c6af51bf-4e80-472f-a461-9129d937e846 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=8023cc33-82ed-49b2-a8e8-69839a1ff66e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0523357
May 28 14:25:15.711888 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Pushing event updated for resources: {'Port': ['ID=f304788f-9f81-4703-80c4-593b1df6747b,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:15.720104 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.366s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:15.730895 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:25:15.834661 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:15.883106 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-91b31a5f-139e-44d3-b1c4-809f61273851 service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3129303
May 28 14:25:15.888307 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.provisioning_blocks [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Transition to ACTIVE for port object dbcc346c-8a01-43e6-927e-2d168febed7c will not be triggered until provisioned by entity DHCP. {{(pid=92694) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:15.945737 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6987ef37-c849-47f0-930c-82bc7b344832 req-9306b343-6361-4d14-a452-a9e77a616128 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:15.947293 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6987ef37-c849-47f0-930c-82bc7b344832 req-9306b343-6361-4d14-a452-a9e77a616128 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 944 time: 0.2977030
May 28 14:25:16.029576 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6987ef37-c849-47f0-930c-82bc7b344832 req-e5b0f287-b0d2-419c-ae28-a70dfdd255e0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0658908
May 28 14:25:16.119048 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:16.123365 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:16.133983 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba281a2e0>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:11Z', 'revision_number': 3, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:16.142248 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da07a4a-7927-4673-9043-fa2eb1c22a63 req-2ae56ef3-d44c-46dd-88a2-afa4bc65b1b9 service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2455304
May 28 14:25:16.142949 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61f238b7-17a8-4c13-a17a-fa534332021b None None] The sync data for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi is: [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:11Z', 'revision_number': 3, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:25:16.226853 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:16.230110 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:16.235292 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:16.269359 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Pushing event updated for resources: {'Port': ['ID=dbcc346c-8a01-43e6-927e-2d168febed7c,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:16.275984 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:16.307989 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:16.842306 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '031d9ce3-9559-48b6-b92f-47ac210b74be', 'tag': '15e73ba1-bc57-49ac-bae9-9906c3fe9522'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:25:16.878431 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-b03e5ef1-5f6e-40a7-b3e8-a240682e823a None None] Provisioning for port dbcc346c-8a01-43e6-927e-2d168febed7c completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:16.884467 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-b03e5ef1-5f6e-40a7-b3e8-a240682e823a None None] Provisioning complete for port dbcc346c-8a01-43e6-927e-2d168febed7c triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:16.893880 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b03e5ef1-5f6e-40a7-b3e8-a240682e823a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:16.997399 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-b03e5ef1-5f6e-40a7-b3e8-a240682e823a None None] Port dbcc346c-8a01-43e6-927e-2d168febed7c cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:25:17.003213 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f304788f-9f81-4703-80c4-593b1df6747b up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:17.114485 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:17.135407 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '031d9ce3-9559-48b6-b92f-47ac210b74be', 'tag': '15e73ba1-bc57-49ac-bae9-9906c3fe9522', 'status': 'completed', 'code': 200}
May 28 14:25:17.198941 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port f304788f-9f81-4703-80c4-593b1df6747b completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:17.206130 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port f304788f-9f81-4703-80c4-593b1df6747b triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:17.206868 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:17.245141 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-392671d3-5810-414e-ae1e-5319c4ba611d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:17.246837 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-392671d3-5810-414e-ae1e-5319c4ba611d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/networks?id=0d994a91-584d-47dc-9f6d-eb7159fb0da8 HTTP/1.1" status: 200  len: 808 time: 0.4878178
May 28 14:25:17.258935 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-973f4408-6ddf-4c66-ad3f-06f3c35617cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:17.266089 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-973f4408-6ddf-4c66-ad3f-06f3c35617cf service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=1db248e02dac49bf8688658eb42ee752&device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 1097 time: 0.0955448
May 28 14:25:17.305368 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-842d487c-8e26-4b48-b8a0-679c2a1f1e3c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/quotas/eba85ed1a1a14a848b3f33435440dff1 HTTP/1.1" status: 200  len: 375 time: 0.0312767
May 28 14:25:17.349213 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:17.366770 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port f304788f-9f81-4703-80c4-593b1df6747b, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f304788f-9f81-4703-80c4-593b1df6747b,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:17.415453 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-d9de5092-f785-4460-b743-e273cf305612 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=eba85ed1a1a14a848b3f33435440dff1&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0993781
May 28 14:25:17.481047 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-7dd8f117-16a5-4e37-9b6d-9f3e4ee07c3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:17.482482 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-7dd8f117-16a5-4e37-9b6d-9f3e4ee07c3d service neutron] 10.222.0.90 "GET /v2.0/networks?id=8023cc33-82ed-49b2-a8e8-69839a1ff66e HTTP/1.1" status: 200  len: 913 time: 0.2120173
May 28 14:25:17.493236 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e32e0d-5554-4df6-a426-90a15a2d6157 req-9c0499ef-f55c-4338-9685-6bb8de1c6685 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:17.493895 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-27e32e0d-5554-4df6-a426-90a15a2d6157 req-9c0499ef-f55c-4338-9685-6bb8de1c6685 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Synchronizing usage tracker for tenant:1db248e02dac49bf8688658eb42ee752 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:25:17.562919 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-24ec2f05-4a84-4317-a4b8-5a777688bd15 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=15e73ba1-bc57-49ac-bae9-9906c3fe9522 HTTP/1.1" status: 200  len: 217 time: 0.0663342
May 28 14:25:17.596432 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-4eee1a24-5173-4ec5-8890-f194f470f68a service neutron] 10.222.0.59 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1734569
May 28 14:25:17.598236 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:17.629659 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-a618d676-ebe4-49f0-85e0-9bb177991d6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:17.631117 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-a618d676-ebe4-49f0-85e0-9bb177991d6b service neutron] 10.222.0.90 "GET /v2.0/subnets?id=00f80d27-adb3-4b05-9355-ad0adc3a3490 HTTP/1.1" status: 200  len: 852 time: 0.0602841
May 28 14:25:17.638609 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:17.641600 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:17.685459 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-27e32e0d-5554-4df6-a426-90a15a2d6157 req-9c0499ef-f55c-4338-9685-6bb8de1c6685 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Unset dirty status for tenant:1db248e02dac49bf8688658eb42ee752 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:25:17.688657 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-27e32e0d-5554-4df6-a426-90a15a2d6157 req-9c0499ef-f55c-4338-9685-6bb8de1c6685 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 944 time: 0.3805659
May 28 14:25:17.690051 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-cc500210-0c39-45d5-874f-9f35d8b6d84d service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=8023cc33-82ed-49b2-a8e8-69839a1ff66e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0504594
May 28 14:25:17.747700 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=f304788f-9f81-4703-80c4-593b1df6747b,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:17.768946 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:17.784934 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:17.844312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-27e32e0d-5554-4df6-a426-90a15a2d6157 req-c2cf2734-cb5e-4328-96cc-7e32eb55a34e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Synchronizing usage tracker for tenant:1db248e02dac49bf8688658eb42ee752 on resource:security_group {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:25:17.848020 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:17.881996 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:17.901289 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-e9633b1d-9449-40e6-a585-07e3297ef7ff service neutron] 10.222.0.59 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2984431
May 28 14:25:17.938227 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-a2bbfc98-1038-4894-bea1-576bdb2c3caf service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2291939
May 28 14:25:18.013778 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 34064) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:18.049286 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Pushing event updated for resources: {'Port': ['ID=dbcc346c-8a01-43e6-927e-2d168febed7c,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:18.052261 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:18.121366 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:18.122668 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:18.166207 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-36009b7c-3ae8-4c82-a546-55f6ee4df921 req-82bf07a2-1e67-42d8-ac63-a0bc85b13f52 service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2170086
May 28 14:25:18.166207 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-27e32e0d-5554-4df6-a426-90a15a2d6157 req-c2cf2734-cb5e-4328-96cc-7e32eb55a34e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Unset dirty status for tenant:1db248e02dac49bf8688658eb42ee752 on resource:security_group {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:25:18.166832 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-27e32e0d-5554-4df6-a426-90a15a2d6157 req-c2cf2734-cb5e-4328-96cc-7e32eb55a34e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4738119
May 28 14:25:18.339147 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2b667c45-078f-4069-9695-ebb1ebbb8aba req-d54758ad-c046-4d5f-a385-8d5e8b82f60c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 210 time: 0.0793934
May 28 14:25:18.343239 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:18.369447 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:18.427531 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Usage tracker for resource:security_group_rule and tenant:30c58cf0e3c542f3a20d59195a295783 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:18.433123 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-e05fefbf-a3cf-4cd2-a26b-9b5813969d68 None None] Provisioning complete for port dbcc346c-8a01-43e6-927e-2d168febed7c triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:18.433593 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-e05fefbf-a3cf-4cd2-a26b-9b5813969d68 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:18.436880 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:18.453245 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:18.490916 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-e05fefbf-a3cf-4cd2-a26b-9b5813969d68 None None] Port dbcc346c-8a01-43e6-927e-2d168febed7c cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:25:18.499521 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Router 0cb62432-a4fe-4ba8-9099-f616594e4211 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:25:18.686204 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 15e73ba1-bc57-49ac-bae9-9906c3fe9522 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:25:18.802692 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:18.825900 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f304788f-9f81-4703-80c4-593b1df6747b up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:18.828227 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:25:18.848077 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] 10.222.0.59 "PUT /v2.0/routers/0cb62432-a4fe-4ba8-9099-f616594e4211/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.1189890
May 28 14:25:18.863442 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Sync routers for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:25:18.882814 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:18.892324 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-bdfde01e-a6f2-481e-81ad-8cc96b3b2503 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:18.896261 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 15e73ba1-bc57-49ac-bae9-9906c3fe9522, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=15e73ba1-bc57-49ac-bae9-9906c3fe9522,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:18.912246 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:25:18.912887 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba318fa30>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:18.934671 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=30c58cf0e3c542f3a20d59195a295783&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9199059
May 28 14:25:18.936486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88adc851-6d55-4830-8d18-3c5523aae795,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:18.938419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34088) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:18.940374 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:18.984335 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '15e73ba1-bc57-49ac-bae9-9906c3fe9522', 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e', 'port_id': '15e73ba1-bc57-49ac-bae9-9906c3fe9522', 'mac_address': 'fa:16:3e:26:3b:ef', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 882, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '00f80d27-adb3-4b05-9355-ad0adc3a3490', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:25:19.023641 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-2febfa10-5670-4c4c-986c-d97d236a7d57 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:19.055914 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-2febfa10-5670-4c4c-986c-d97d236a7d57 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:19.155815 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:19.179122 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port f304788f-9f81-4703-80c4-593b1df6747b triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:19.179122 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:19.233022 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:25:19.278755 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 15e73ba1-bc57-49ac-bae9-9906c3fe9522 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:25:19.291128 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-2febfa10-5670-4c4c-986c-d97d236a7d57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:19.297486 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b19cb01c-4108-4f21-91e4-8f8b903374a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:19.334143 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2febfa10-5670-4c4c-986c-d97d236a7d57 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88adc851-6d55-4830-8d18-3c5523aae795,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:19.337399 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 15e73ba1-bc57-49ac-bae9-9906c3fe9522, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=15e73ba1-bc57-49ac-bae9-9906c3fe9522,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:19.352170 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-2febfa10-5670-4c4c-986c-d97d236a7d57 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:19.353477 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-2febfa10-5670-4c4c-986c-d97d236a7d57 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/88adc851-6d55-4830-8d18-3c5523aae795 HTTP/1.1" status: 204  len: 168 time: 0.4079103
May 28 14:25:19.355574 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-2febfa10-5670-4c4c-986c-d97d236a7d57 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:19.473823 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb req-9822ebb7-0c0a-449f-b0cf-570ee6012cc7 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:19.475542 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb req-9822ebb7-0c0a-449f-b0cf-570ee6012cc7 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 944 time: 0.1329889
May 28 14:25:19.530157 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:19.536545 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-5f26aae2-0a4d-43d4-ad34-3065040b8725 req-b654ec70-f4e3-4814-a82b-191e1257a1c4 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Synchronizing usage tracker for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:25:19.539934 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b25a1195-a4e0-404d-b48d-d0f0176ef2cb req-3f4646de-aac5-41c3-b5e0-e3811df86c37 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0537672
May 28 14:25:19.564002 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:19.622320 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-5f26aae2-0a4d-43d4-ad34-3065040b8725 req-b654ec70-f4e3-4814-a82b-191e1257a1c4 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Unset dirty status for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:25:19.628476 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5f26aae2-0a4d-43d4-ad34-3065040b8725 req-b654ec70-f4e3-4814-a82b-191e1257a1c4 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 210 time: 0.1331367
May 28 14:25:19.738475 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=15e73ba1-bc57-49ac-bae9-9906c3fe9522,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:19.742997 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:19.853202 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba318fa30>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 2, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:19.857218 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Checking router: 0cb62432-a4fe-4ba8-9099-f616594e4211 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:25:19.857571 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Updating router 0cb62432-a4fe-4ba8-9099-f616594e4211 port dbcc346c-8a01-43e6-927e-2d168febed7c binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:25:19.914820 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:19.989385 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['15e73ba1-bc57-49ac-bae9-9906c3fe9522'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:25:20.068492 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 34128) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:20.074724 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1735660950-network', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:20.080137 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:20.085226 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Usage tracker for resource:network and tenant:ad1c8d68ed024b78a40404830469679a is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:20.088214 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:20.094657 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:20.187219 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Made reservation on behalf of ad1c8d68ed024b78a40404830469679a for: {'network': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:25:20.190182 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.205772 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.223382 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:20.228371 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Usage tracker for resource:security_group_rule and tenant:ad1c8d68ed024b78a40404830469679a is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:20.232392 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:20.241070 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:20.373105 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.444929 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.456908 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Transition to ACTIVE for port object dbcc346c-8a01-43e6-927e-2d168febed7c will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:20.496181 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.500888 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5ed772c8-3eba-4925-95af-afeede680262 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:20.524965 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] vlan segment allocate from pool success with {'vlan_id': 864, 'physical_network': 'physnet1'}  {{(pid=92694) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:25:20.538288 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acaa7c11-1c9e-441b-a131-87776bc22c73,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:20.542244 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:20.543186 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.543535 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.segments_db [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Added segment f6996eef-8c71-4352-86d9-29ab92a9a61d of type vlan for network 912c2088-541f-4bb4-8926-5637b475c28c
May 28 14:25:20.559210 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.565011 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:20.571296 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.753937 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.755786 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:20.758839 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.764680 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a767b18-8e8a-4ba5-9aa6-79f403ae3799 None None] Pushing event updated for resources: {'Port': ['ID=dbcc346c-8a01-43e6-927e-2d168febed7c,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:20.789741 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:20.796421 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-9a767b18-8e8a-4ba5-9aa6-79f403ae3799 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:20.840021 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Attempting to bind port dbcc346c-8a01-43e6-927e-2d168febed7c on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:20.848018 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Attempting to bind port dbcc346c-8a01-43e6-927e-2d168febed7c by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:20.848018 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Attempting to bind port dbcc346c-8a01-43e6-927e-2d168febed7c on network 89b0ce92-0695-466c-b1ce-9a354ecba633 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:20.854453 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 25, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:20.859063 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Checking segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:20.859784 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.860360 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Bound using segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:20.861020 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Bound port: dbcc346c-8a01-43e6-927e-2d168febed7c, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:20.861582 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:20.934018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 req-e575d333-e51e-4951-bb5b-b6694261bbad tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:20.940772 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 req-e575d333-e51e-4951-bb5b-b6694261bbad tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 945 time: 0.2839606
May 28 14:25:20.965634 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-aee355b6-36bd-4d84-9980-b3612f6fe751 req-2aaf2220-016e-48be-a951-d9f39d80dbc6 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 210 time: 0.0812728
May 28 14:25:20.990836 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Pushing event updated for resources: {'Network': ['ID=912c2088-541f-4bb4-8926-5637b475c28c,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:21.000206 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 912c2088-541f-4bb4-8926-5637b475c28c details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:25:21.003936 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:21.034627 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.9620814
May 28 14:25:21.037507 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34160) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:21.046530 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Request body: {'subnet': {'network_id': '912c2088-541f-4bb4-8926-5637b475c28c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1735660950-subnet', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'ip_version': 4}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:21.051353 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:21.056031 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Usage tracker for resource:subnet and tenant:ad1c8d68ed024b78a40404830469679a is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:21.059002 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:21.079466 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:21.094252 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] For port dbcc346c-8a01-43e6-927e-2d168febed7c, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:21.097030 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4efb5988-1fc3-4dde-a24e-a77c8ba33964 req-d42f5f1a-2966-4b9b-9679-6bc1b979f062 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1483328
May 28 14:25:21.152580 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] For port dbcc346c-8a01-43e6-927e-2d168febed7c, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=dbcc346c-8a01-43e6-927e-2d168febed7c,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:21.224340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Made reservation on behalf of ad1c8d68ed024b78a40404830469679a for: {'subnet': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:25:21.226643 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1808138'] for subnet, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:21.285249 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:21.290973 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-a4ce2a87-c9ea-4e61-ae99-c84d47d79f8a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:21.390602 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a767b18-8e8a-4ba5-9aa6-79f403ae3799 None None] Pushing event updated for resources: {'Port': ['ID=dbcc346c-8a01-43e6-927e-2d168febed7c,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:21.402698 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:25:21.403688 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba318fa30>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:21.486961 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-9a767b18-8e8a-4ba5-9aa6-79f403ae3799 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:21.489783 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-3f2f498c-0ab7-47c9-8590-7ce29c7eea43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:21.491255 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-3f2f498c-0ab7-47c9-8590-7ce29c7eea43 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.90 "GET /v2.0/networks?id=0d994a91-584d-47dc-9f6d-eb7159fb0da8 HTTP/1.1" status: 200  len: 808 time: 0.3463817
May 28 14:25:21.508722 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Request body: {'port': {'device_id': '27eed777-874a-4f63-898a-6d4f77aef89d', 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8', 'admin_state_up': True, 'tenant_id': 'eba85ed1a1a14a848b3f33435440dff1'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:21.660492 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:25:21.739995 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:21.755780 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:21.854617 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Made reservation on behalf of eba85ed1a1a14a848b3f33435440dff1 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:25:21.854617 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:22.035707 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba318fa30>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:21Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:22.040108 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bf42b07-55d9-452d-bed7-47839cc72e05 None None] The sync data for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi is: [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:21Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:25:22.180858 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Allocated IP 172.20.0.8 (0d994a91-584d-47dc-9f6d-eb7159fb0da8/09cda8a0-3e03-4e9f-ab1c-ce37af69f629/5e55d283-7678-4380-b5d1-eda7730dd76b) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:22.196710 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-601e7411-6eb7-46ac-8df5-1f711cc53427 req-85e766fb-39ac-4935-9e76-5c7730de000e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 210 time: 0.0954299
May 28 14:25:22.354545 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5fb1df-99ee-405d-9c43-da88cc1df14e req-e53308c9-d8bd-40e1-b5e5-61993e5c0ce5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:22.362264 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0a5fb1df-99ee-405d-9c43-da88cc1df14e req-e53308c9-d8bd-40e1-b5e5-61993e5c0ce5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 945 time: 0.1253409
May 28 14:25:22.414455 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0a5fb1df-99ee-405d-9c43-da88cc1df14e req-6ff86a89-4e4a-4241-aed4-6013d172dc25 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0510256
May 28 14:25:22.455290 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1635813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1808156'] for subnet, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:22.468176 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:22.574078 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Pushing event updated for resources: {'Subnet': ['ID=c066b4f0-1088-4ade-93ac-a76eb3a53395,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:22.587051 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:22.600419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Checking segment: {'id': 'f6996eef-8c71-4352-86d9-29ab92a9a61d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:22.600770 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Network hostable DHCP agents. Network: 912c2088-541f-4bb4-8926-5637b475c28c, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92695) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:25:22.621925 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:22.719019 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Network 912c2088-541f-4bb4-8926-5637b475c28c is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92695) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:25:22.747996 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:22.754319 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:22.814034 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 912c2088-541f-4bb4-8926-5637b475c28c) {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:22.828967 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-320cded0-7c79-43ec-9e0f-d4a0b97465b4 None None] Network 912c2088-541f-4bb4-8926-5637b475c28c requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:25:22.838980 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:22.843277 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:22.843898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:22.847484 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:22.853702 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:22.888035 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Pushing event updated for resources: {'Port': ['ID=5e55d283-7678-4380-b5d1-eda7730dd76b,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:22.914909 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.915262 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.915678 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.915980 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.916312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.916647 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.917083 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.917424 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.917755 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.918085 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.918418 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.918741 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:22.928531 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:22.945727 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:22.946354 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:22.949758 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device dbcc346c-8a01-43e6-927e-2d168febed7c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:23.091893 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 2.0531538
May 28 14:25:23.095064 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34188) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:23.100364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:23.105924 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:23.114170 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Usage tracker for resource:router and tenant:ad1c8d68ed024b78a40404830469679a is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:23.123905 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-912c2088-541f-4bb4-8926-5637b475c28c', 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'fixed_ips': [{'subnet_id': 'c066b4f0-1088-4ade-93ac-a76eb3a53395'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:25:23.124899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:23.125036 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.130927 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:23.149690 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.6463559
May 28 14:25:23.251373 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port dbcc346c-8a01-43e6-927e-2d168febed7c completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:23.266585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port dbcc346c-8a01-43e6-927e-2d168febed7c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:23.266980 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.272174 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.273478 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.292077 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.336916 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Allocated IP 172.20.0.2 (912c2088-541f-4bb4-8926-5637b475c28c/c066b4f0-1088-4ade-93ac-a76eb3a53395/f92cbf85-69fd-4d96-b020-3966aa3c19a3) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:23.402565 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14755890-1df2-4e28-bef2-43d6e48c2ff3 req-466f3aaf-753a-450d-bef3-d57d0b7ac8a5 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:23.405283 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-14755890-1df2-4e28-bef2-43d6e48c2ff3 req-466f3aaf-753a-450d-bef3-d57d0b7ac8a5 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 931 time: 0.0903032
May 28 14:25:23.453531 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-14755890-1df2-4e28-bef2-43d6e48c2ff3 req-626ea5f1-23e4-48d9-9fc5-b90a97fa90ae tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421674
May 28 14:25:23.476224 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 15e73ba1-bc57-49ac-bae9-9906c3fe9522 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:23.586463 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.642402 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e06b5c4-1165-4e83-a9dd-411b2887d57b req-7d00a8a1-0843-4cfe-a9f6-53d729cc029f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:23.644462 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8e06b5c4-1165-4e83-a9dd-411b2887d57b req-7d00a8a1-0843-4cfe-a9f6-53d729cc029f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 945 time: 0.0854616
May 28 14:25:23.659937 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port dbcc346c-8a01-43e6-927e-2d168febed7c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=dbcc346c-8a01-43e6-927e-2d168febed7c,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:23.690739 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8e06b5c4-1165-4e83-a9dd-411b2887d57b req-8e7bd853-750f-4a5f-a697-e8c241379820 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402112
May 28 14:25:23.701113 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.736689 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.747991 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Transition to ACTIVE for port object f92cbf85-69fd-4d96-b020-3966aa3c19a3 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:23.754837 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 15e73ba1-bc57-49ac-bae9-9906c3fe9522 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:23.766213 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 15e73ba1-bc57-49ac-bae9-9906c3fe9522 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:23.766590 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.812811 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Transition to ACTIVE for port object f92cbf85-69fd-4d96-b020-3966aa3c19a3 will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:23.820951 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.830795 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-d0f457ac-233b-4c44-b114-1ef31f687007 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:23.921911 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:23.932370 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=dbcc346c-8a01-43e6-927e-2d168febed7c,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:23.938878 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:23.946645 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.018s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:24.040291 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Network 912c2088-541f-4bb4-8926-5637b475c28c is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:24.047803 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:24.053128 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:24.069192 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Pushing event updated for resources: {'Port': ['ID=f92cbf85-69fd-4d96-b020-3966aa3c19a3,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:24.094859 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:24.101244 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:24.176537 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '031d9ce3-9559-48b6-b92f-47ac210b74be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15e73ba1-bc57-49ac-bae9-9906c3fe9522'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:25:24.190372 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Attempting to bind port f92cbf85-69fd-4d96-b020-3966aa3c19a3 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:24.190753 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Attempting to bind port f92cbf85-69fd-4d96-b020-3966aa3c19a3 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': 'f6996eef-8c71-4352-86d9-29ab92a9a61d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:24.191140 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Attempting to bind port f92cbf85-69fd-4d96-b020-3966aa3c19a3 on network 912c2088-541f-4bb4-8926-5637b475c28c {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:24.194067 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 15e73ba1-bc57-49ac-bae9-9906c3fe9522, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=15e73ba1-bc57-49ac-bae9-9906c3fe9522,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:24.198359 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 25, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:24.203021 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Checking segment: {'id': 'f6996eef-8c71-4352-86d9-29ab92a9a61d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:24.203021 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:24.203021 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Bound using segment: {'id': 'f6996eef-8c71-4352-86d9-29ab92a9a61d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:24.203021 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Bound port: f92cbf85-69fd-4d96-b020-3966aa3c19a3, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f6996eef-8c71-4352-86d9-29ab92a9a61d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:24.203021 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:24.227591 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:24.241985 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '031d9ce3-9559-48b6-b92f-47ac210b74be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15e73ba1-bc57-49ac-bae9-9906c3fe9522', 'code': 200}
May 28 14:25:24.260679 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:24.292237 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] For port f92cbf85-69fd-4d96-b020-3966aa3c19a3, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:24.295841 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] For port f92cbf85-69fd-4d96-b020-3966aa3c19a3, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f92cbf85-69fd-4d96-b020-3966aa3c19a3,segment=NetworkSegment(f6996eef-8c71-4352-86d9-29ab92a9a61d),segment_id=f6996eef-8c71-4352-86d9-29ab92a9a61d)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:24.297336 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:24.299187 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-c62eca21-09d4-4ca2-b7a6-43a99f9e7887 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:24.368083 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=15e73ba1-bc57-49ac-bae9-9906c3fe9522,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:24.371148 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:24.403758 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Allocated IP 172.27.3.104 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/157c40a0-a937-4c79-a7cf-b7750bbc415d) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:24.439161 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:24.443820 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:24.520970 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Pushing event updated for resources: {'Port': ['ID=f92cbf85-69fd-4d96-b020-3966aa3c19a3,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:24.523984 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:24.576961 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:24.675188 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 req-d39c0c50-4df3-4b7e-84ca-54fea90693e4 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:24.677144 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 req-d39c0c50-4df3-4b7e-84ca-54fea90693e4 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 931 time: 0.0967710
May 28 14:25:24.684747 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:24.688924 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:24.756190 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1ea9ed1c-a795-489d-bf5a-b83d69e37389 req-55e04632-b6b4-4996-97cb-f6f56e0d6b65 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0731258
May 28 14:25:24.773416 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:24.776306 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:24.780292 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:24.826061 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Pushing event updated for resources: {'Port': ['ID=157c40a0-a937-4c79-a7cf-b7750bbc415d,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:24.834716 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:25.007705 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device dbcc346c-8a01-43e6-927e-2d168febed7c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:25.008347 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-287a8d32-5d9b-4bcf-9065-325216a467f9 req-eb90519f-3bd2-431f-be09-f1b92a20c714 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:25.011664 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-287a8d32-5d9b-4bcf-9065-325216a467f9 req-eb90519f-3bd2-431f-be09-f1b92a20c714 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 946 time: 0.1183193
May 28 14:25:25.069104 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-287a8d32-5d9b-4bcf-9065-325216a467f9 req-6ee0318b-7fe4-4116-af74-82ae1a36d589 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512192
May 28 14:25:25.099751 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port dbcc346c-8a01-43e6-927e-2d168febed7c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:25.100132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:25.241645 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f92cbf85-69fd-4d96-b020-3966aa3c19a3 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:25.370412 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:25.420821 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port f92cbf85-69fd-4d96-b020-3966aa3c19a3 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:25.557044 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5909405-f3c4-46e5-968d-2b31a22a5c77 None None] Network 912c2088-541f-4bb4-8926-5637b475c28c requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:25:25.776580 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7e4c9d4f-9503-4810-a5c0-3a73af34281e None None] Provisioning for port f92cbf85-69fd-4d96-b020-3966aa3c19a3 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:25.788500 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7e4c9d4f-9503-4810-a5c0-3a73af34281e None None] Provisioning complete for port f92cbf85-69fd-4d96-b020-3966aa3c19a3 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:25.788668 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7e4c9d4f-9503-4810-a5c0-3a73af34281e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:25.818720 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:25.915175 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Request body: {'port': {'device_id': '27eed777-874a-4f63-898a-6d4f77aef89d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:25.951098 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7e4c9d4f-9503-4810-a5c0-3a73af34281e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:25.958676 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074b86f1-d462-4f92-8566-ada660dc9cf1 req-c4fece7b-e021-43f2-93fe-0db2d4088522 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:25.962449 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-074b86f1-d462-4f92-8566-ada660dc9cf1 req-c4fece7b-e021-43f2-93fe-0db2d4088522 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 931 time: 0.0957942
May 28 14:25:26.011453 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7e4c9d4f-9503-4810-a5c0-3a73af34281e None None] For port f92cbf85-69fd-4d96-b020-3966aa3c19a3, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f92cbf85-69fd-4d96-b020-3966aa3c19a3,segment=NetworkSegment(f6996eef-8c71-4352-86d9-29ab92a9a61d),segment_id=f6996eef-8c71-4352-86d9-29ab92a9a61d)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:26.036347 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-074b86f1-d462-4f92-8566-ada660dc9cf1 req-850c569f-aab6-45bf-8ef1-5f73917635e1 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0666063
May 28 14:25:26.107461 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7e4c9d4f-9503-4810-a5c0-3a73af34281e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:26.110055 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-9a767b18-8e8a-4ba5-9aa6-79f403ae3799 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:26.169945 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:26.218413 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e4c9d4f-9503-4810-a5c0-3a73af34281e None None] Pushing event updated for resources: {'Port': ['ID=f92cbf85-69fd-4d96-b020-3966aa3c19a3,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:26.222736 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7e4c9d4f-9503-4810-a5c0-3a73af34281e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:26.236692 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-d8483c95-0164-407a-9327-1b85ed89edeb None None] Provisioning complete for port f92cbf85-69fd-4d96-b020-3966aa3c19a3 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:26.236692 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d8483c95-0164-407a-9327-1b85ed89edeb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:26.459438 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28ea0e2-8df0-4596-b4af-1cd736d24484 req-1f041057-7980-4939-a54b-0f16d2eac5f7 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:26.460897 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b28ea0e2-8df0-4596-b4af-1cd736d24484 req-1f041057-7980-4939-a54b-0f16d2eac5f7 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 946 time: 0.2382641
May 28 14:25:26.495529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Router 92316894-5ec1-402d-b60e-488e93b9cd37 is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92695) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:25:26.660669 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfd135e-f22b-4d3c-8e26-469344df3bb4 req-4c97da45-f3fb-4a71-b9e7-656edd1e211b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:26.662045 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7cfd135e-f22b-4d3c-8e26-469344df3bb4 req-4c97da45-f3fb-4a71-b9e7-656edd1e211b service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 1099 time: 0.2934515
May 28 14:25:26.673778 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b28ea0e2-8df0-4596-b4af-1cd736d24484 req-6408d674-c12f-4754-8303-ef4af9dbfbb9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1950216
May 28 14:25:26.824207 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7cfd135e-f22b-4d3c-8e26-469344df3bb4 req-c8c8ddf9-467f-4105-afb1-4ed89909b5f7 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1302521
May 28 14:25:26.836507 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f92cbf85-69fd-4d96-b020-3966aa3c19a3 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:26.879382 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:25:26.889414 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Sync routers for ids ['92316894-5ec1-402d-b60e-488e93b9cd37'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:25:26.899021 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Routers {'92316894-5ec1-402d-b60e-488e93b9cd37'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:25:26.899659 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba281ad30>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['92316894-5ec1-402d-b60e-488e93b9cd37'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:26.904711 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port f92cbf85-69fd-4d96-b020-3966aa3c19a3 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:26.905241 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:26.922428 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5e55d283-7678-4380-b5d1-eda7730dd76b {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:25:26.929935 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:26.945840 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Transition to ACTIVE for port object 5e55d283-7678-4380-b5d1-eda7730dd76b will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:27.005206 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:27.007299 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 3.9109957
May 28 14:25:27.009921 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34230) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:27.104339 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:27.111942 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Set router 92316894-5ec1-402d-b60e-488e93b9cd37 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:25:27.126722 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:27.439482 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba281ad30>, [{'id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:23Z', 'updated_at': '2021-05-28T14:25:25Z', 'revision_number': 3, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'gw_port': {'id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b1:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_gateway', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:24Z', 'updated_at': '2021-05-28T14:25:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:27.443167 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Checking router: 92316894-5ec1-402d-b60e-488e93b9cd37 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:25:27.443522 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Updating router 92316894-5ec1-402d-b60e-488e93b9cd37 port 157c40a0-a937-4c79-a7cf-b7750bbc415d binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:25:27.499011 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:27.534743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Pushing event updated for resources: {'Port': ['ID=5e55d283-7678-4380-b5d1-eda7730dd76b,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:27.547441 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.421s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:27.735800 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Attempting to bind port 5e55d283-7678-4380-b5d1-eda7730dd76b on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:27.736136 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Attempting to bind port 5e55d283-7678-4380-b5d1-eda7730dd76b by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '89622796-8108-4109-9bba-4e78e65fc59e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:27.736467 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Attempting to bind port 5e55d283-7678-4380-b5d1-eda7730dd76b on network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:27.745841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13fada5b-fb92-41d4-a19c-149775f3f9c3 req-2fe7ce99-92df-4542-a843-97d99090bd0a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:27.746712 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-13fada5b-fb92-41d4-a19c-149775f3f9c3 req-2fe7ce99-92df-4542-a843-97d99090bd0a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Synchronizing usage tracker for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:25:27.821626 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:27.837894 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Port 5e55d283-7678-4380-b5d1-eda7730dd76b on network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:25:27.838406 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Attempting to bind port 5e55d283-7678-4380-b5d1-eda7730dd76b on network 0d994a91-584d-47dc-9f6d-eb7159fb0da8 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:27.850854 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 25, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:27.854259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Checking segment: {'id': '89622796-8108-4109-9bba-4e78e65fc59e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:27.854259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Bound using segment: {'id': '89622796-8108-4109-9bba-4e78e65fc59e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:27.854259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Bound port: 5e55d283-7678-4380-b5d1-eda7730dd76b, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '89622796-8108-4109-9bba-4e78e65fc59e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:27.854259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:27.873880 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:27.886180 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Transition to ACTIVE for port object 157c40a0-a937-4c79-a7cf-b7750bbc415d will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:27.915701 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d67bdd3a-a98d-459c-a028-0d825c6511c3 req-2fa00dc8-7b44-4ab9-acb9-b6f1644a9c07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:27.917224 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d67bdd3a-a98d-459c-a028-0d825c6511c3 req-2fa00dc8-7b44-4ab9-acb9-b6f1644a9c07 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 946 time: 0.1011615
May 28 14:25:27.996378 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d67bdd3a-a98d-459c-a028-0d825c6511c3 req-217dd5e1-e9dd-4677-b0a8-2a9e0adabdad tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0701180
May 28 14:25:27.998672 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-13fada5b-fb92-41d4-a19c-149775f3f9c3 req-2fe7ce99-92df-4542-a843-97d99090bd0a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Unset dirty status for tenant:eba85ed1a1a14a848b3f33435440dff1 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:25:27.999936 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-13fada5b-fb92-41d4-a19c-149775f3f9c3 req-2fe7ce99-92df-4542-a843-97d99090bd0a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.8200507
May 28 14:25:28.005345 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:28.013974 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:28.115480 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Attempting to bind port 157c40a0-a937-4c79-a7cf-b7750bbc415d on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:28.115884 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Attempting to bind port 157c40a0-a937-4c79-a7cf-b7750bbc415d by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:28.116251 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Attempting to bind port 157c40a0-a937-4c79-a7cf-b7750bbc415d on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:28.130935 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 25, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:28.131751 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:28.132388 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:28.132942 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:28.133573 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Bound port: 157c40a0-a937-4c79-a7cf-b7750bbc415d, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:28.134407 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:28.167226 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] For port 5e55d283-7678-4380-b5d1-eda7730dd76b, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:28.175330 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-13fada5b-fb92-41d4-a19c-149775f3f9c3 req-addd23c2-e051-45bc-a689-7002ae678681 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1564929
May 28 14:25:28.182933 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] For port 5e55d283-7678-4380-b5d1-eda7730dd76b, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=5e55d283-7678-4380-b5d1-eda7730dd76b,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:28.193089 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b98801d-539d-45bd-bdfd-f30c4102e62f None None] Pushing event updated for resources: {'Port': ['ID=157c40a0-a937-4c79-a7cf-b7750bbc415d,revision_number=2']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:28.195993 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-1b98801d-539d-45bd-bdfd-f30c4102e62f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:28.238988 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] For port 157c40a0-a937-4c79-a7cf-b7750bbc415d, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:28.243418 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] For port 157c40a0-a937-4c79-a7cf-b7750bbc415d, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=157c40a0-a937-4c79-a7cf-b7750bbc415d,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:28.297781 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:28.306430 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-95cf52f7-0189-4f3d-9e16-4d708194397a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:28.319368 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:28.333436 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-1b98801d-539d-45bd-bdfd-f30c4102e62f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:28.383665 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:28.390783 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:28.392370 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] 10.222.0.90 "PUT /v2.0/ports/5e55d283-7678-4380-b5d1-eda7730dd76b HTTP/1.1" status: 200  len: 1093 time: 2.4814942
May 28 14:25:28.393148 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '27eed777-874a-4f63-898a-6d4f77aef89d', 'tag': '5e55d283-7678-4380-b5d1-eda7730dd76b'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:25:28.400917 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Routers {'92316894-5ec1-402d-b60e-488e93b9cd37'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:25:28.401860 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba281ad30>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['92316894-5ec1-402d-b60e-488e93b9cd37'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:28.456923 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Pushing event updated for resources: {'Port': ['ID=5e55d283-7678-4380-b5d1-eda7730dd76b,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:28.474848 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:28.493602 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:28.590629 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '27eed777-874a-4f63-898a-6d4f77aef89d', 'tag': '5e55d283-7678-4380-b5d1-eda7730dd76b', 'status': 'completed', 'code': 200}
May 28 14:25:28.595681 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b98801d-539d-45bd-bdfd-f30c4102e62f None None] Pushing event updated for resources: {'Port': ['ID=157c40a0-a937-4c79-a7cf-b7750bbc415d,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:28.600913 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-1b98801d-539d-45bd-bdfd-f30c4102e62f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:28.629251 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] Set router 92316894-5ec1-402d-b60e-488e93b9cd37 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:25:28.831581 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-53e41572-da71-458d-8d04-007c9dd95797 req-50710765-dd1c-4f81-b9a4-b9fcf6efd9d8 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2869749
May 28 14:25:28.881999 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-1ba12de9-581b-4fb3-b8ec-13bd999d3bd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:28.883571 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-1ba12de9-581b-4fb3-b8ec-13bd999d3bd7 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=eba85ed1a1a14a848b3f33435440dff1&device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 1096 time: 0.2885962
May 28 14:25:28.923215 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Allocated IP 172.20.0.1 (912c2088-541f-4bb4-8926-5637b475c28c/c066b4f0-1088-4ade-93ac-a76eb3a53395/d1893a4d-9338-4a9c-9071-849f6a2123b5) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:28.990825 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba281ad30>, [{'id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:23Z', 'updated_at': '2021-05-28T14:25:25Z', 'revision_number': 3, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'gw_port': {'id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b1:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_gateway', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:24Z', 'updated_at': '2021-05-28T14:25:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:28.995049 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4782e6e9-8f35-4725-b9d7-63eb37baa9d3 None None] The sync data for ids ['92316894-5ec1-402d-b60e-488e93b9cd37'] in dv-cinder-791281-3-iscsi is: [{'id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:23Z', 'updated_at': '2021-05-28T14:25:25Z', 'revision_number': 3, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'gw_port': {'id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b1:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_gateway', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:24Z', 'updated_at': '2021-05-28T14:25:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:25:29.133034 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26e59c8-4179-441d-990a-806394694691 req-0ec3cc99-e060-4cd0-94b2-c409b1e27cd8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:29.134884 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e26e59c8-4179-441d-990a-806394694691 req-0ec3cc99-e060-4cd0-94b2-c409b1e27cd8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1011631
May 28 14:25:29.159998 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:29.190716 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e26e59c8-4179-441d-990a-806394694691 req-f6cb53ad-7b18-44c9-8295-04bcb454ce61 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461915
May 28 14:25:29.193386 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Transition to ACTIVE for port object d1893a4d-9338-4a9c-9071-849f6a2123b5 will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:29.229267 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 req-c8763f66-f385-4966-bc74-d2bde16d2340 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:29.230837 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 req-c8763f66-f385-4966-bc74-d2bde16d2340 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 946 time: 0.1122208
May 28 14:25:29.300544 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:29.310483 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-2e1ae2d4-7fa8-4f76-8211-16d62cd0843f tempest-DeleteServersTestJSON-533202138 tempest-DeleteServersTestJSON-533202138-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:29.436458 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 req-dcdfaa3c-9909-446f-8f2d-685d99ad2a75 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:29.437992 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 req-dcdfaa3c-9909-446f-8f2d-685d99ad2a75 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0974517
May 28 14:25:29.477143 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f08caac8-3faf-46d7-8261-f8d5d8d8b7d4 req-e897d8fb-cc40-41b3-bf18-77cba558b7d8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2398157
May 28 14:25:29.483536 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Network 912c2088-541f-4bb4-8926-5637b475c28c is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:29.486628 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:29.490748 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:29.509816 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5e183025-51d8-4687-8bfb-c58ec0a0ace1 req-4f5fc4f7-6db0-46d6-a31e-8031d2a85232 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0657396
May 28 14:25:29.543094 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Pushing event updated for resources: {'Port': ['ID=d1893a4d-9338-4a9c-9071-849f6a2123b5,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:29.547527 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:29.570047 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:29.850043 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-8adb95f0-df54-4ef6-ad17-99cccdfb035a None None] Provisioning for port d1893a4d-9338-4a9c-9071-849f6a2123b5 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:29.855878 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-8adb95f0-df54-4ef6-ad17-99cccdfb035a None None] Provisioning complete for port d1893a4d-9338-4a9c-9071-849f6a2123b5 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:29.856259 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8adb95f0-df54-4ef6-ad17-99cccdfb035a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:29.876940 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:29.915087 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-8adb95f0-df54-4ef6-ad17-99cccdfb035a None None] Port d1893a4d-9338-4a9c-9071-849f6a2123b5 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:25:30.038450 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d529c1fb-0711-469a-ae12-cc2538e91a25 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:30.111475 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:30.225548 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:30.253569 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:30.335575 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Pushing event updated for resources: {'Port': ['ID=d1893a4d-9338-4a9c-9071-849f6a2123b5,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:30.338049 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:30.341633 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:30.396458 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60a258e8-5a8c-4688-bd60-bbab392e8a72 req-a1bbcfac-6e13-4d62-aecd-6ed7e1274c40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:30.398021 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-60a258e8-5a8c-4688-bd60-bbab392e8a72 req-a1bbcfac-6e13-4d62-aecd-6ed7e1274c40 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0888817
May 28 14:25:30.456190 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-60a258e8-5a8c-4688-bd60-bbab392e8a72 req-624b4d98-1c88-4755-a55d-51a85d1ddc55 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515671
May 28 14:25:30.492809 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Network 912c2088-541f-4bb4-8926-5637b475c28c is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:30.494037 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:30.718980 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Router 92316894-5ec1-402d-b60e-488e93b9cd37 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:25:30.719861 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53682f0-a4b3-465c-a8c8-142ff6899026 req-30f00e32-b28d-4b9c-a322-d43ca7e9167f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:30.721392 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c53682f0-a4b3-465c-a8c8-142ff6899026 req-30f00e32-b28d-4b9c-a322-d43ca7e9167f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0988007
May 28 14:25:30.747112 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-26fde0de-30aa-4ace-9ac5-5b952434ccb5 None None] Provisioning complete for port d1893a4d-9338-4a9c-9071-849f6a2123b5 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:30.751038 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-26fde0de-30aa-4ace-9ac5-5b952434ccb5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:30.834549 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c53682f0-a4b3-465c-a8c8-142ff6899026 req-3d8e5200-d561-4f3f-b5b1-9cf616a96a05 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1049390
May 28 14:25:30.866766 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-26fde0de-30aa-4ace-9ac5-5b952434ccb5 None None] Port d1893a4d-9338-4a9c-9071-849f6a2123b5 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:25:30.903994 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 157c40a0-a937-4c79-a7cf-b7750bbc415d up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:30.949808 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:25:30.959562 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Sync routers for ids ['92316894-5ec1-402d-b60e-488e93b9cd37'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:25:30.960909 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] 10.222.0.59 "PUT /v2.0/routers/92316894-5ec1-402d-b60e-488e93b9cd37/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.9499261
May 28 14:25:30.973916 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Routers {'92316894-5ec1-402d-b60e-488e93b9cd37'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:25:30.975104 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba22b8370>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['92316894-5ec1-402d-b60e-488e93b9cd37'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:31.131018 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 157c40a0-a937-4c79-a7cf-b7750bbc415d completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:31.148490 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 157c40a0-a937-4c79-a7cf-b7750bbc415d triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:31.149386 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:31.218176 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Set router 92316894-5ec1-402d-b60e-488e93b9cd37 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:25:31.503978 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:31.538908 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 157c40a0-a937-4c79-a7cf-b7750bbc415d, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=157c40a0-a937-4c79-a7cf-b7750bbc415d,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:31.618405 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:31.620747 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:31.669894 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba22b8370>, [{'id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:23Z', 'updated_at': '2021-05-28T14:25:29Z', 'revision_number': 4, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'gw_port': {'id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b1:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_gateway', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:24Z', 'updated_at': '2021-05-28T14:25:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'd1893a4d-9338-4a9c-9071-849f6a2123b5', 'name': '', 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'mac_address': 'fa:16:3e:3d:1e:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_interface', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': 'c066b4f0-1088-4ade-93ac-a76eb3a53395', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:28Z', 'updated_at': '2021-05-28T14:25:29Z', 'revision_number': 2, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'subnets': [{'id': 'c066b4f0-1088-4ade-93ac-a76eb3a53395', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:31.678925 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Checking router: 92316894-5ec1-402d-b60e-488e93b9cd37 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:25:31.679281 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Updating router 92316894-5ec1-402d-b60e-488e93b9cd37 port d1893a4d-9338-4a9c-9071-849f6a2123b5 binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:25:31.731753 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=157c40a0-a937-4c79-a7cf-b7750bbc415d,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:31.736570 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:31.740783 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:31.881930 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34344) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:31.887226 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2127224596', 'description': 'tempest-secgroup-smoke-2127224596 description', 'project_id': 'c6d2d25991f04f00a48394ddbeec688e'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:31.896013 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:31.902410 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:security_group and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:31.907232 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:31.915713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:32.004173 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.024349 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:32.028828 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:security_group_rule and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:32.032608 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:32.039169 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:32.047460 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a0d291-8ef0-471a-8d04-15632cd0b3af req-4a5a1b42-8ad3-40e6-a0e6-59e24abc1b31 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:32.048550 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b6a0d291-8ef0-471a-8d04-15632cd0b3af req-4a5a1b42-8ad3-40e6-a0e6-59e24abc1b31 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0864146
May 28 14:25:32.102640 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b6a0d291-8ef0-471a-8d04-15632cd0b3af req-56367626-e9c5-4b1c-a9ba-22ee87ad7d29 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473905
May 28 14:25:32.116892 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.117670 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.129978 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Transition to ACTIVE for port object d1893a4d-9338-4a9c-9071-849f6a2123b5 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:32.227016 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.233636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c3b55403-df44-4003-9365-e5c44cbab385 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:32.256076 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.260902 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7e4c9d4f-9503-4810-a5c0-3a73af34281e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:32.274805 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fe9fa133-b1e0-4e56-971e-af9cdb27b031,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:32.280625 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:32.298161 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45944ca-da94-42dd-ac34-51c6db502fa9 req-4d487f98-fecf-4c79-80a8-79f8ff66338f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:32.299843 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b45944ca-da94-42dd-ac34-51c6db502fa9 req-4d487f98-fecf-4c79-80a8-79f8ff66338f tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0976462
May 28 14:25:32.353259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.355610 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.4718866
May 28 14:25:32.360025 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b45944ca-da94-42dd-ac34-51c6db502fa9 req-8d9b4d14-36a2-435b-9904-5f365ee38d27 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0484419
May 28 14:25:32.360735 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34352) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:32.366217 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'security_group_rule': {'security_group_id': 'fe9fa133-b1e0-4e56-971e-af9cdb27b031', 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:32.381177 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:32.393619 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:security_group_rule and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:32.393619 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:32.396614 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:32.429296 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c1c74ec-3e62-4e4e-95b2-810b4a4cef05 None None] Pushing event updated for resources: {'Port': ['ID=d1893a4d-9338-4a9c-9071-849f6a2123b5,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:32.439495 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-8c1c74ec-3e62-4e4e-95b2-810b4a4cef05 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:32.491044 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.515875 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Attempting to bind port d1893a4d-9338-4a9c-9071-849f6a2123b5 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:32.516242 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Attempting to bind port d1893a4d-9338-4a9c-9071-849f6a2123b5 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': 'f6996eef-8c71-4352-86d9-29ab92a9a61d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:32.516620 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Attempting to bind port d1893a4d-9338-4a9c-9071-849f6a2123b5 on network 912c2088-541f-4bb4-8926-5637b475c28c {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:32.525726 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 25, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:32.526093 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Checking segment: {'id': 'f6996eef-8c71-4352-86d9-29ab92a9a61d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:32.526496 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.531143 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Bound using segment: {'id': 'f6996eef-8c71-4352-86d9-29ab92a9a61d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:32.531143 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Bound port: d1893a4d-9338-4a9c-9071-849f6a2123b5, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f6996eef-8c71-4352-86d9-29ab92a9a61d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:32.531143 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.559386 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.572439 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.603880 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7f5d9ff9-3aff-4600-ba14-d9c4481ac0f5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.618679 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] For port d1893a4d-9338-4a9c-9071-849f6a2123b5, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:32.621724 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] For port d1893a4d-9338-4a9c-9071-849f6a2123b5, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=d1893a4d-9338-4a9c-9071-849f6a2123b5,segment=NetworkSegment(f6996eef-8c71-4352-86d9-29ab92a9a61d),segment_id=f6996eef-8c71-4352-86d9-29ab92a9a61d)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:32.632792 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.634830 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:32.658899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2316952f-2c64-47c4-894c-80d58a062ab3,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:32.664384 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:32.701812 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.705526 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:32.752866 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.754070 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3922844
May 28 14:25:32.756807 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34356) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:32.762299 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'security_group_rule': {'security_group_id': 'fe9fa133-b1e0-4e56-971e-af9cdb27b031', 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:32.768773 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:32.772890 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:security_group_rule and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:32.775763 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:32.782590 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:32.783070 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Routers {'92316894-5ec1-402d-b60e-488e93b9cd37'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:25:32.783722 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba22b8370>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['92316894-5ec1-402d-b60e-488e93b9cd37'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:32.841104 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c1c74ec-3e62-4e4e-95b2-810b4a4cef05 None None] Pushing event updated for resources: {'Port': ['ID=d1893a4d-9338-4a9c-9071-849f6a2123b5,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:32.852264 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-8c1c74ec-3e62-4e4e-95b2-810b4a4cef05 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:32.865051 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 157c40a0-a937-4c79-a7cf-b7750bbc415d up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:32.875004 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:32.948129 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.033825 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 157c40a0-a937-4c79-a7cf-b7750bbc415d triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:33.034190 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.048408 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.050427 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-39a0eb47-65c0-4a0f-9b48-49dabb120583 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:33.060237 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] Set router 92316894-5ec1-402d-b60e-488e93b9cd37 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:25:33.073014 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bce335fa-1a97-4062-9653-aa5530a46ac5,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:33.075456 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:33.147859 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.151920 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.3914464
May 28 14:25:33.152278 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34364) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:33.161994 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'security_group_rule': {'security_group_id': 'fe9fa133-b1e0-4e56-971e-af9cdb27b031', 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:33.168312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:33.174229 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:security_group_rule and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:33.177238 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:33.183019 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:33.314663 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1c81a0-d8fe-4141-a1da-e1706008f7da req-4af1a520-8f0b-4424-bc2a-cbe6a31ae3db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:33.316274 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7f1c81a0-d8fe-4141-a1da-e1706008f7da req-4af1a520-8f0b-4424-bc2a-cbe6a31ae3db tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0919018
May 28 14:25:33.333683 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.416057 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.466523 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7f1c81a0-d8fe-4141-a1da-e1706008f7da req-509c3e63-a4de-49e8-860c-a5fb83debfe9 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1336625
May 28 14:25:33.494271 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.496803 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c7bf1534-2151-4d4a-9bed-8f8578a55aab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:33.523993 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6c046a56-d6d6-4bf3-aa2f-44d3d73b961c,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:33.526474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:33.539363 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba22b8370>, [{'id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:23Z', 'updated_at': '2021-05-28T14:25:29Z', 'revision_number': 4, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'gw_port': {'id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b1:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_gateway', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:24Z', 'updated_at': '2021-05-28T14:25:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'd1893a4d-9338-4a9c-9071-849f6a2123b5', 'name': '', 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'mac_address': 'fa:16:3e:3d:1e:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_interface', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': 'c066b4f0-1088-4ade-93ac-a76eb3a53395', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:28Z', 'updated_at': '2021-05-28T14:25:32Z', 'revision_number': 4, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'subnets': [{'id': 'c066b4f0-1088-4ade-93ac-a76eb3a53395', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:33.543418 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f3b742f-5017-4986-b973-5e04e2b2e0b8 None None] The sync data for ids ['92316894-5ec1-402d-b60e-488e93b9cd37'] in dv-cinder-791281-3-iscsi is: [{'id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:23Z', 'updated_at': '2021-05-28T14:25:29Z', 'revision_number': 4, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'gw_port': {'id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b1:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_gateway', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:24Z', 'updated_at': '2021-05-28T14:25:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'd1893a4d-9338-4a9c-9071-849f6a2123b5', 'name': '', 'network_id': '912c2088-541f-4bb4-8926-5637b475c28c', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'mac_address': 'fa:16:3e:3d:1e:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_interface', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': 'c066b4f0-1088-4ade-93ac-a76eb3a53395', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:28Z', 'updated_at': '2021-05-28T14:25:32Z', 'revision_number': 4, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'subnets': [{'id': 'c066b4f0-1088-4ade-93ac-a76eb3a53395', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:25:33.605499 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.606681 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-3e6feff8-c209-4633-bab9-ec5a6fde0e2c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4533422
May 28 14:25:33.609861 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34374) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:33.626023 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'security_group_rule': {'security_group_id': 'fe9fa133-b1e0-4e56-971e-af9cdb27b031', 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:33.631815 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:33.635508 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:security_group_rule and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:33.647175 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:33.655915 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:33.675971 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce4a77d9-247b-44d2-a723-e88b07394d8e req-e21ef49d-0e54-4023-9a85-7e40bb720b65 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:33.677372 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ce4a77d9-247b-44d2-a723-e88b07394d8e req-e21ef49d-0e54-4023-9a85-7e40bb720b65 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.1086595
May 28 14:25:33.694094 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.729758 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ce4a77d9-247b-44d2-a723-e88b07394d8e req-1112161c-3ae5-4c2b-bccb-14863ce21bc6 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459220
May 28 14:25:33.730100 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.805242 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.884690 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:33.886839 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:33.911375 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=89330813-8308-4c17-91cd-26256a798df3,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:33.921032 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:34.032757 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:34.036807 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-0c657e19-7d7c-493c-92e9-1c08deab1d50 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.4235661
May 28 14:25:34.037695 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 34380) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:34.042590 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'security_group_rule': {'security_group_id': 'fe9fa133-b1e0-4e56-971e-af9cdb27b031', 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:34.049845 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:34.053955 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:security_group_rule and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:34.056997 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:34.072071 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:34.208445 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.securitygroups_db [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Project c6d2d25991f04f00a48394ddbeec688e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 28 14:25:34.212712 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:34.288029 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:34.451635 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:34.455209 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:34.478844 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4bed4144-b033-47e0-b71c-9119800c370e,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:34.493412 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.494262 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.494817 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.495164 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.495357 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-d0acfeed-c5f1-45be-aa51-441b74625b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:34.495502 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.496029 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.496458 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.496802 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.496900 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-d0acfeed-c5f1-45be-aa51-441b74625b07 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=eba85ed1a1a14a848b3f33435440dff1&shared=False HTTP/1.1" status: 200  len: 909 time: 0.3058081
May 28 14:25:34.497142 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.497475 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.497807 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.498732 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:25:34.499492 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e41572-da71-458d-8d04-007c9dd95797 req-1dcf2a1f-6bea-4b4c-8354-cd201d89d490 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:34.501570 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-53e41572-da71-458d-8d04-007c9dd95797 req-1dcf2a1f-6bea-4b4c-8354-cd201d89d490 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1098 time: 0.3080571
May 28 14:25:34.503509 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:34.564202 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:34.565585 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.5272977
May 28 14:25:34.568118 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 34392) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:34.573625 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'security_group_rule': {'security_group_id': 'fe9fa133-b1e0-4e56-971e-af9cdb27b031', 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:34.581849 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:34.588078 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:security_group_rule and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:34.593214 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:34.604792 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:34.713899 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3373a09-9c86-4712-b823-dab7c6499931 req-2b8560eb-776f-4d4c-ae1b-07160fb51d49 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:34.715319 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e3373a09-9c86-4712-b823-dab7c6499931 req-2b8560eb-776f-4d4c-ae1b-07160fb51d49 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1048603
May 28 14:25:34.753730 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.securitygroups_db [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Project c6d2d25991f04f00a48394ddbeec688e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 28 14:25:34.761847 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:34.769759 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-71faa331-4bbc-4665-8ab4-7809ac220bb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:34.771540 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b7aedfe4-719c-4e42-ad03-2223017bb5e1 req-71faa331-4bbc-4665-8ab4-7809ac220bb3 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2620153
May 28 14:25:34.777067 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e41572-da71-458d-8d04-007c9dd95797 req-61f1946d-0868-4a88-8581-ed4fba3a9471 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:34.781344 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-53e41572-da71-458d-8d04-007c9dd95797 req-61f1946d-0868-4a88-8581-ed4fba3a9471 service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.2484574
May 28 14:25:34.787202 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e3373a09-9c86-4712-b823-dab7c6499931 req-23f96aef-a8d5-481b-bc3d-a0ada181597f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0653870
May 28 14:25:34.851485 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:34.917575 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device d1893a4d-9338-4a9c-9071-849f6a2123b5 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:34.935299 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:34.938069 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:34.971201 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=370c2f97-747d-4e8a-9798-3c8228fe1358,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:34.979125 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:35.014846 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-53e41572-da71-458d-8d04-007c9dd95797 req-f03fb8c0-dd45-4dab-a6ff-0a3b95eebc38 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 200  len: 1001 time: 0.2218244
May 28 14:25:35.038897 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:35.041128 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.4712400
May 28 14:25:35.076745 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port d1893a4d-9338-4a9c-9071-849f6a2123b5 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:35.079510 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port d1893a4d-9338-4a9c-9071-849f6a2123b5 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:35.085685 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:35.117565 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-a428dba7-eef6-429f-80a9-56fbd52a896b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:35.119030 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-a428dba7-eef6-429f-80a9-56fbd52a896b service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=eba85ed1a1a14a848b3f33435440dff1&device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 1096 time: 0.2566326
May 28 14:25:35.120333 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e41572-da71-458d-8d04-007c9dd95797 req-f0f2f913-c460-4c60-ab58-7206922cb7de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:35.121914 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-53e41572-da71-458d-8d04-007c9dd95797 req-f0f2f913-c460-4c60-ab58-7206922cb7de service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.0948787
May 28 14:25:35.141037 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 req-189140a3-bd6d-4eb3-ae27-d56cfeeec3b4 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:35.142968 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 req-189140a3-bd6d-4eb3-ae27-d56cfeeec3b4 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.1997349
May 28 14:25:35.238917 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:35.283366 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port d1893a4d-9338-4a9c-9071-849f6a2123b5, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=d1893a4d-9338-4a9c-9071-849f6a2123b5,segment=NetworkSegment(f6996eef-8c71-4352-86d9-29ab92a9a61d),segment_id=f6996eef-8c71-4352-86d9-29ab92a9a61d)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:35.292297 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-3ac351c1-8567-4b37-8281-58b4ca3856bf service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5e55d283-7678-4380-b5d1-eda7730dd76b HTTP/1.1" status: 200  len: 217 time: 0.1463480
May 28 14:25:35.353480 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:35.387454 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1a14f7fd-6f7f-4bdc-a5c1-e17ff88c1630 req-c536e8f1-b61f-4627-b06e-8741941d933e tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1455598
May 28 14:25:35.387957 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:35.391657 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-0b4299f0-f12e-4435-a37b-9892953fd0b4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:35.403536 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-ce273f07-ed27-418b-8146-0b5f203447ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:35.405589 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-ce273f07-ed27-418b-8146-0b5f203447ee service neutron] 10.222.0.90 "GET /v2.0/subnets?id=09cda8a0-3e03-4e9f-ab1c-ce37af69f629 HTTP/1.1" status: 200  len: 848 time: 0.1007941
May 28 14:25:35.414862 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e41572-da71-458d-8d04-007c9dd95797 req-08651b0c-75b2-4763-95ab-f821f8d7200f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:35.414862 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-53e41572-da71-458d-8d04-007c9dd95797 req-08651b0c-75b2-4763-95ab-f821f8d7200f service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2692132
May 28 14:25:35.515727 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-4ab8b830-2125-4b16-9a2f-3039594ac740 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=0d994a91-584d-47dc-9f6d-eb7159fb0da8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0827680
May 28 14:25:35.541873 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=d1893a4d-9338-4a9c-9071-849f6a2123b5,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:35.552939 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:35.725564 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-53e41572-da71-458d-8d04-007c9dd95797 req-58ec2207-b884-4362-9ecb-95fac3f78703 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2507534
May 28 14:25:35.768974 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-581b7f99-8a15-42aa-8fe3-a3a3a735f965 service neutron] 10.222.0.90 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2041543
May 28 14:25:36.115960 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-53e41572-da71-458d-8d04-007c9dd95797 req-4edacd5b-4f0a-4a79-bc8a-ce1c59c9fe68 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3788574
May 28 14:25:36.142632 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f3d4410-5afd-47d2-a77e-95429f889548 req-af887de3-5a1a-4c15-8260-dcc0c310cc52 service neutron] 10.222.0.90 "GET /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3296773
May 28 14:25:36.158370 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-899d0fb9-43af-4494-8516-ea5bc8a11a25 req-a0896636-9c9b-4686-a31b-149f9fc2ade6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:36.159896 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-899d0fb9-43af-4494-8516-ea5bc8a11a25 req-a0896636-9c9b-4686-a31b-149f9fc2ade6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1699972
May 28 14:25:36.207681 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-899d0fb9-43af-4494-8516-ea5bc8a11a25 req-f93ba0e2-6284-4a18-b161-a31ac12249ed tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410378
May 28 14:25:36.601223 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c84731-e1bf-46ed-a049-90d5c99939b3 req-ebabf682-d7a1-414f-bcff-8a45d3f99741 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:36.602592 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c4c84731-e1bf-46ed-a049-90d5c99939b3 req-ebabf682-d7a1-414f-bcff-8a45d3f99741 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0873830
May 28 14:25:36.648108 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c4c84731-e1bf-46ed-a049-90d5c99939b3 req-360af13e-2c3e-4afc-a701-671a2a34b453 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395155
May 28 14:25:36.831736 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device d1893a4d-9338-4a9c-9071-849f6a2123b5 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:36.902961 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port d1893a4d-9338-4a9c-9071-849f6a2123b5 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:36.903346 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:37.405602 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddf6395f-de54-4072-adf3-7524bd2ffe67 req-57193fdf-ea48-40fe-809a-01c6b971bf36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:37.407162 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddf6395f-de54-4072-adf3-7524bd2ffe67 req-57193fdf-ea48-40fe-809a-01c6b971bf36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0855629
May 28 14:25:37.455154 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddf6395f-de54-4072-adf3-7524bd2ffe67 req-04ead7a3-4771-4d4c-acc9-3f05d3c2a88d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422413
May 28 14:25:37.842725 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197b20b6-8b29-4cc0-82da-385a2fe58f12 req-53f79990-f8b7-46ec-9691-8622d32c0789 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:37.844207 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-197b20b6-8b29-4cc0-82da-385a2fe58f12 req-53f79990-f8b7-46ec-9691-8622d32c0789 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0857890
May 28 14:25:37.888521 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-197b20b6-8b29-4cc0-82da-385a2fe58f12 req-2eccd2c1-4df7-45f2-8515-aae5328ffbbd tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384974
May 28 14:25:38.647126 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb req-1baab1c6-4b93-4426-bdda-b20a9cdc92cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:38.648644 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb req-1baab1c6-4b93-4426-bdda-b20a9cdc92cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0830553
May 28 14:25:38.694926 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3e4f15eb-83f7-4b0b-b57d-c8e4233b74cb req-6edc1a04-296b-43a5-a39f-a11b1d55e541 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406904
May 28 14:25:39.076662 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 req-97413f3b-9995-4e99-a9d4-e27268b61858 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:39.078083 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 req-97413f3b-9995-4e99-a9d4-e27268b61858 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0811110
May 28 14:25:39.122593 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6e6e767a-31db-4f51-a30a-2658a0dd8ef7 req-047a1278-ee7f-45cb-9065-2f4c9784f306 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388494
May 28 14:25:39.543402 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:25:39.877235 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 req-63c639c1-9e8d-4a02-a11a-e0a9aecdaf0f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:39.878742 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 req-63c639c1-9e8d-4a02-a11a-e0a9aecdaf0f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0807939
May 28 14:25:39.923697 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2f081ff4-c2d8-4925-b8c2-6b28e5d69b66 req-46db1c0f-6857-4ada-bac7-982cce9c8ef0 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393503
May 28 14:25:40.307546 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 req-dfe27ea8-b5e5-4f4b-afa1-f887c72fd411 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:40.309003 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 req-dfe27ea8-b5e5-4f4b-afa1-f887c72fd411 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0837209
May 28 14:25:40.356169 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2c56f6a0-9cde-46a2-baeb-acee17a1e603 req-00236dac-9a62-49a1-b9d4-6613a94d5a0a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408103
May 28 14:25:41.110897 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41b9c719-4905-411d-ad3d-a555b56551d0 req-39d9d0b2-7630-4d91-9839-2a5e40c62477 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:41.112398 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-41b9c719-4905-411d-ad3d-a555b56551d0 req-39d9d0b2-7630-4d91-9839-2a5e40c62477 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0788372
May 28 14:25:41.160771 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-41b9c719-4905-411d-ad3d-a555b56551d0 req-b7c7fc45-f22c-4987-949d-87794c8de420 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422151
May 28 14:25:41.536021 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 req-0ce79f0d-02f7-49b9-a79c-77de7bacecfe tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:41.537479 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 req-0ce79f0d-02f7-49b9-a79c-77de7bacecfe tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0787308
May 28 14:25:41.581435 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9fd38b72-7a38-438b-8ccc-0a012c4b8421 req-ab6a87fc-738e-4205-928a-7c88283fd910 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383475
May 28 14:25:42.357876 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d279cee-c688-4905-b507-13fadf1f13ce req-40634241-2df2-4668-bfc4-7d4abf949b9a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:42.359249 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0d279cee-c688-4905-b507-13fadf1f13ce req-40634241-2df2-4668-bfc4-7d4abf949b9a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0893812
May 28 14:25:42.403290 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0d279cee-c688-4905-b507-13fadf1f13ce req-cae21c69-4c3a-48e1-9a12-48688e17b474 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383286
May 28 14:25:42.764834 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9079db49-5746-4bb0-b104-9a05cee7f7eb req-5df780a7-47d2-40f5-9443-cafb785ecd57 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:42.766320 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9079db49-5746-4bb0-b104-9a05cee7f7eb req-5df780a7-47d2-40f5-9443-cafb785ecd57 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0786595
May 28 14:25:42.809361 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9079db49-5746-4bb0-b104-9a05cee7f7eb req-4c51fa36-b95d-48c8-b875-ea0f48ffb075 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0375249
May 28 14:25:43.586162 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20027c62-d2e2-49ad-b543-4d32dc910ada req-c23deb6b-8909-4b5b-ac1b-71534813ac81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:43.587637 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-20027c62-d2e2-49ad-b543-4d32dc910ada req-c23deb6b-8909-4b5b-ac1b-71534813ac81 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.0810854
May 28 14:25:43.633431 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-20027c62-d2e2-49ad-b543-4d32dc910ada req-99cc822b-c2ab-4dbf-927f-614b85e2b1e6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396385
May 28 14:25:44.012797 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b86a320-7d0a-4132-966b-da542680225c req-c11e6a8a-2d80-4190-ad0a-a94b9002c765 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:44.014919 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6b86a320-7d0a-4132-966b-da542680225c req-c11e6a8a-2d80-4190-ad0a-a94b9002c765 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0943177
May 28 14:25:44.061024 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6b86a320-7d0a-4132-966b-da542680225c req-5ae22eb5-21d7-4798-91a3-4cbb6442caa7 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402894
May 28 14:25:44.878328 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78452a03-8484-486c-bccf-3c9c34ba8d7f req-dabb964d-26a3-442b-adf2-1d48c72bbde4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:44.879979 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-78452a03-8484-486c-bccf-3c9c34ba8d7f req-dabb964d-26a3-442b-adf2-1d48c72bbde4 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1314137
May 28 14:25:44.941544 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-78452a03-8484-486c-bccf-3c9c34ba8d7f req-18aee564-1675-4734-a7f7-5059905c02cc tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0551987
May 28 14:25:44.954059 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-7977e090-4b84-46c0-a176-66a04900da1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:44.955595 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-7977e090-4b84-46c0-a176-66a04900da1d tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.90 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 945 time: 0.1399300
May 28 14:25:45.110250 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Deleting port 9328e999-33b7-4ad7-9796-283089726539 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:25:45.110885 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:45.274421 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] For port 9328e999-33b7-4ad7-9796-283089726539, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=9328e999-33b7-4ad7-9796-283089726539,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:45.274776 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:45.292008 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 req-5bb4547d-677c-45c7-ac85-aea8c9f9c412 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:45.301083 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 req-5bb4547d-677c-45c7-ac85-aea8c9f9c412 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.1051724
May 28 14:25:45.416742 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-635d39ff-b6be-4ca4-9dcd-deb570d0a978 req-f5a84b4c-26df-43db-9ae2-a3d256c49264 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1146755
May 28 14:25:45.442201 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling delete_port for 9328e999-33b7-4ad7-9796-283089726539 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:25:45.655947 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:45.667727 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:45.681516 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['a600bf0f-8706-4c30-ae48-005a0b8b9b84', '9328e999-33b7-4ad7-9796-283089726539'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:25:45.757063 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Pushing event deleted for resources: {'Port': ['ID=9328e999-33b7-4ad7-9796-283089726539,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:45.768416 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:45.822798 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] No DVR routers for this DVR port 9328e999-33b7-4ad7-9796-283089726539 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:25:45.828027 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:45.832134 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5800de57-f9fa-4ca8-9f94-a8880f3c595f', 'name': 'network-vif-deleted', 'tag': '9328e999-33b7-4ad7-9796-283089726539'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:25:45.948026 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a9328f5a-971e-4f74-8b84-0efc9d8d3526 req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.90 "DELETE /v2.0/ports/9328e999-33b7-4ad7-9796-283089726539 HTTP/1.1" status: 204  len: 173 time: 0.9839621
May 28 14:25:46.077258 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5800de57-f9fa-4ca8-9f94-a8880f3c595f', 'name': 'network-vif-deleted', 'tag': '9328e999-33b7-4ad7-9796-283089726539', 'status': 'completed', 'code': 200}
May 28 14:25:46.134450 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 5e55d283-7678-4380-b5d1-eda7730dd76b details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:25:46.153353 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-f510752c-968f-49cc-93e7-1621e5d382b0 req-5fdb050f-dd1b-4f97-b19b-2efd3525e3e5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Synchronizing usage tracker for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:25:46.331014 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 5e55d283-7678-4380-b5d1-eda7730dd76b, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=5e55d283-7678-4380-b5d1-eda7730dd76b,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:46.347478 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '5e55d283-7678-4380-b5d1-eda7730dd76b', 'network_id': '0d994a91-584d-47dc-9f6d-eb7159fb0da8', 'port_id': '5e55d283-7678-4380-b5d1-eda7730dd76b', 'mac_address': 'fa:16:3e:8a:7c:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 855, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '09cda8a0-3e03-4e9f-ab1c-ce37af69f629', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:25:46.423079 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:46.447790 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5e55d283-7678-4380-b5d1-eda7730dd76b {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:25:46.468739 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 5e55d283-7678-4380-b5d1-eda7730dd76b, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=5e55d283-7678-4380-b5d1-eda7730dd76b,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:46.551246 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-f510752c-968f-49cc-93e7-1621e5d382b0 req-5fdb050f-dd1b-4f97-b19b-2efd3525e3e5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Unset dirty status for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:25:46.552560 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f510752c-968f-49cc-93e7-1621e5d382b0 req-5fdb050f-dd1b-4f97-b19b-2efd3525e3e5 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.4480393
May 28 14:25:46.632153 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 req-789e5dd6-5b4c-4bed-90c1-19463253ff59 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:46.639199 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 req-789e5dd6-5b4c-4bed-90c1-19463253ff59 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 943 time: 0.0970294
May 28 14:25:46.645418 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:46.647234 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:46.691548 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2616a6f0-2b09-4f55-9aad-dd7791f9ad79 req-6922099c-3134-406c-aa9b-73c8a2e258c9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515003
May 28 14:25:46.736660 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=5e55d283-7678-4380-b5d1-eda7730dd76b,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:46.740037 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:47.332730 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['5e55d283-7678-4380-b5d1-eda7730dd76b'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:25:47.727905 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dd855e05-855f-475e-b391-23fad4db02c4 req-3b18ef16-9ffe-4c76-a6bc-b6350c5260ee tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=5800de57-f9fa-4ca8-9f94-a8880f3c595f HTTP/1.1" status: 200  len: 210 time: 0.0477560
May 28 14:25:47.903568 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7332b5-769f-4375-9cb7-fb291863bb80 req-e7e881f0-8b7c-4075-a8e4-a0d1522d420c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:47.905689 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4d7332b5-769f-4375-9cb7-fb291863bb80 req-e7e881f0-8b7c-4075-a8e4-a0d1522d420c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 944 time: 0.0934680
May 28 14:25:47.957330 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4d7332b5-769f-4375-9cb7-fb291863bb80 req-50d61d24-748a-4b61-9d62-d8cdfde38332 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446639
May 28 14:25:48.138781 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 9328e999-33b7-4ad7-9796-283089726539 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:25:48.175668 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 9328e999-33b7-4ad7-9796-283089726539 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:25:48.176356 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 9328e999-33b7-4ad7-9796-283089726539 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:25:49.284119 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64dbf44e-ad50-407b-b6d3-089e04eddd18 req-a89055bd-c87a-4f8e-a67a-992978aa2bcb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:49.285567 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-64dbf44e-ad50-407b-b6d3-089e04eddd18 req-a89055bd-c87a-4f8e-a67a-992978aa2bcb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 944 time: 0.0859962
May 28 14:25:49.331486 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-64dbf44e-ad50-407b-b6d3-089e04eddd18 req-0e100f9c-baad-4dba-810b-110554680f62 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400584
May 28 14:25:49.445461 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 req-9fbb447b-3462-4094-80ff-9b538ce0974f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:49.446916 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 req-9fbb447b-3462-4094-80ff-9b538ce0974f tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0831349
May 28 14:25:49.493477 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7e73aa1f-bbde-4ff3-9a0a-1973982a5554 req-24cfd752-9876-4742-9d0a-174d1032dd86 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400131
May 28 14:25:50.132969 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 5e55d283-7678-4380-b5d1-eda7730dd76b up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:50.335585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 5e55d283-7678-4380-b5d1-eda7730dd76b completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:50.340506 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 5e55d283-7678-4380-b5d1-eda7730dd76b triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:50.340875 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:50.459887 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:50.487898 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27eed777-874a-4f63-898a-6d4f77aef89d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e55d283-7678-4380-b5d1-eda7730dd76b'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:25:50.498942 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 5e55d283-7678-4380-b5d1-eda7730dd76b, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=5e55d283-7678-4380-b5d1-eda7730dd76b,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:50.530445 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491fd059-edfa-4bde-ac74-f08fc3064d76 req-45956b58-022e-457f-a18a-4d213e0e06f5 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:50.531984 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-491fd059-edfa-4bde-ac74-f08fc3064d76 req-45956b58-022e-457f-a18a-4d213e0e06f5 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 944 time: 0.0909729
May 28 14:25:50.534925 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '27eed777-874a-4f63-898a-6d4f77aef89d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e55d283-7678-4380-b5d1-eda7730dd76b', 'code': 200}
May 28 14:25:50.583063 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:50.585929 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:50.667246 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-491fd059-edfa-4bde-ac74-f08fc3064d76 req-f72b9759-40fd-402a-ac97-90d8d1103376 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1287854
May 28 14:25:50.729487 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004d1834-bf6d-496c-858d-b88c3622ad19 req-94ecc21b-5d93-4bb9-be81-8aded469d674 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:50.731272 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-004d1834-bf6d-496c-858d-b88c3622ad19 req-94ecc21b-5d93-4bb9-be81-8aded469d674 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0988538
May 28 14:25:50.765105 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=5e55d283-7678-4380-b5d1-eda7730dd76b,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:50.768947 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:50.890435 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-004d1834-bf6d-496c-858d-b88c3622ad19 req-e23eeb5d-dfd0-443f-947d-7c4f1b4bdc14 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1528227
May 28 14:25:51.003981 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-706d36dd-bc9b-4868-b17b-e913ea24f6e7 req-4e69bd2f-a498-40ab-8110-6911ad4c19a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:51.005418 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-706d36dd-bc9b-4868-b17b-e913ea24f6e7 req-4e69bd2f-a498-40ab-8110-6911ad4c19a7 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 1098 time: 0.0719154
May 28 14:25:51.055948 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-706d36dd-bc9b-4868-b17b-e913ea24f6e7 req-fc8daca0-5769-48a0-abb0-4e4e55a5c62b service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0353179
May 28 14:25:51.291740 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 34786) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:51.412141 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:51.427196 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:51.431161 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Usage tracker for resource:security_group_rule and tenant:6cc735324ca54cf0abad90cf8b685fb3 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:51.434022 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:51.441501 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:51.525575 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:51.598179 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:51.606042 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-65eaf12d-5f2a-4b92-a360-e319a564d070 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:51.646024 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=6cc735324ca54cf0abad90cf8b685fb3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3530662
May 28 14:25:51.646777 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0acfb45-2c1a-4c62-a3f3-4f97e919c190,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:51.648731 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34794) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:51.650251 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:51.710259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3b7cb86b-0913-499b-ba00-6c64b6742c76 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:51.737008 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3b7cb86b-0913-499b-ba00-6c64b6742c76 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:51.860890 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21ebdd9a-3955-4e72-b8c8-a2175accf513 req-79b87cfa-648b-4a94-8be3-0a8e12cdd9cb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:51.862340 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-21ebdd9a-3955-4e72-b8c8-a2175accf513 req-79b87cfa-648b-4a94-8be3-0a8e12cdd9cb tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 945 time: 0.0839033
May 28 14:25:51.914163 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-21ebdd9a-3955-4e72-b8c8-a2175accf513 req-b764229d-c18c-4ea6-9008-49bec5907973 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443795
May 28 14:25:51.946741 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3b7cb86b-0913-499b-ba00-6c64b6742c76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:51.954658 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-300e0b84-8b7c-436b-8d8e-545df0849793 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:51.965483 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7cb86b-0913-499b-ba00-6c64b6742c76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0acfb45-2c1a-4c62-a3f3-4f97e919c190,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:51.968841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3b7cb86b-0913-499b-ba00-6c64b6742c76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:51.975415 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3b7cb86b-0913-499b-ba00-6c64b6742c76 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:51.978841 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-3b7cb86b-0913-499b-ba00-6c64b6742c76 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/d0acfb45-2c1a-4c62-a3f3-4f97e919c190 HTTP/1.1" status: 204  len: 168 time: 0.3268268
May 28 14:25:52.084943 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 req-b97a88d5-cf5e-4167-97f2-4df8c3d5c31a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:52.086385 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 req-b97a88d5-cf5e-4167-97f2-4df8c3d5c31a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.0826077
May 28 14:25:52.132173 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8dda5bf0-512e-4164-a520-51d1f5f7fd54 req-49d47727-6c22-42ea-b24e-69ff638756a6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394249
May 28 14:25:53.099386 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34838) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:53.124009 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-181f9364-3ce4-41a5-8650-5298821a028a req-436785e6-4bc0-4a39-9885-dd6008cf580c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:53.125661 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-181f9364-3ce4-41a5-8650-5298821a028a req-436785e6-4bc0-4a39-9885-dd6008cf580c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 945 time: 0.0819221
May 28 14:25:53.187478 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-181f9364-3ce4-41a5-8650-5298821a028a req-997cfd12-eb80-4298-8a03-f7bfcaefc62c tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0522385
May 28 14:25:53.230686 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34848) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:53.301885 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-623751679-network', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:53.311619 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:53.319210 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Usage tracker for resource:network and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:53.322655 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:53.347686 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:53.350726 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.370734 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:53.377553 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Usage tracker for resource:security_group_rule and tenant:a3d6ade2c4594eb89911d2ee81c8846e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:53.380866 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:53.388852 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:53.421906 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673edda1-0bae-4dab-9ad8-ed2d5396374f req-75760409-97e6-4595-b4a4-e940eaa144c7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:53.423332 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-673edda1-0bae-4dab-9ad8-ed2d5396374f req-75760409-97e6-4595-b4a4-e940eaa144c7 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1619437
May 28 14:25:53.471724 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Made reservation on behalf of cf7193774c754e07a6f683666ab4addf for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:25:53.471724 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.490023 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.503663 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-673edda1-0bae-4dab-9ad8-ed2d5396374f req-cbb6a9e1-3f06-4197-bcc9-6485da24726a tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0734065
May 28 14:25:53.514674 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:53.526001 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Usage tracker for resource:security_group_rule and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:53.530448 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:53.542656 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:53.564223 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.641395 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.651063 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-90b820f3-1d69-44a5-ae77-0d71e7c7cb1e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:53.706394 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a3d6ade2c4594eb89911d2ee81c8846e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6057181
May 28 14:25:53.707335 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8100e8a0-8f7a-490e-9ca4-968028320f2c,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:53.711172 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:53.711700 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 34856) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:53.774710 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6e621635-ee64-4edb-91ea-5b11bc15686a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.775585 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.801097 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6e621635-ee64-4edb-91ea-5b11bc15686a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.871204 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.875032 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5923dc35-a393-426a-81da-e1e551a65ca7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:53.908389 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=978436a2-dde3-4072-8794-d45c60dfdcd1,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:53.911363 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:53.964154 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6e621635-ee64-4edb-91ea-5b11bc15686a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.969969 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9ee00304-2930-4bb2-9832-2e38a45102af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:53.972006 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] vlan segment allocate from pool success with {'vlan_id': 857, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:25:53.980848 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:53.981189 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Added segment 5d4a0d84-b33a-4965-b76a-6b4579480439 of type vlan for network 780506d2-6c05-4b1f-af1f-a4a3d627ec86
May 28 14:25:53.981771 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e621635-ee64-4edb-91ea-5b11bc15686a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8100e8a0-8f7a-490e-9ca4-968028320f2c,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:53.986507 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6e621635-ee64-4edb-91ea-5b11bc15686a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:54.003201 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6e621635-ee64-4edb-91ea-5b11bc15686a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:54.006903 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6e621635-ee64-4edb-91ea-5b11bc15686a admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/8100e8a0-8f7a-490e-9ca4-968028320f2c HTTP/1.1" status: 204  len: 168 time: 0.2941024
May 28 14:25:54.011996 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:54.099753 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:54.101150 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:54.101742 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:54.107783 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:54.211668 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Pushing event updated for resources: {'Network': ['ID=780506d2-6c05-4b1f-af1f-a4a3d627ec86,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:54.214430 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:54.222961 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:25:54.339439 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 34868) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:54.340072 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.1078272
May 28 14:25:54.346506 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Request body: {'subnet': {'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-623751679-subnet', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:54.351665 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:54.356037 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Usage tracker for resource:subnet and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:54.359223 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:54.365977 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:54.390041 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8e2961-af6f-45a6-9962-5a555438a214 req-82c74797-c531-4bf0-80bb-adbae0606a2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:54.391740 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dc8e2961-af6f-45a6-9962-5a555438a214 req-82c74797-c531-4bf0-80bb-adbae0606a2a tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 945 time: 0.0984433
May 28 14:25:54.448169 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dc8e2961-af6f-45a6-9962-5a555438a214 req-6cf8d3c3-ef7d-45e9-935b-831d109e63a0 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0502341
May 28 14:25:54.461144 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Made reservation on behalf of cf7193774c754e07a6f683666ab4addf for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:25:54.463515 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3521847'] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:54.738342 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1529a88-ff10-432a-9919-4bc8b84b799b req-1530dc89-2e43-4092-b276-78fecf4d51ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:54.739845 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e1529a88-ff10-432a-9919-4bc8b84b799b req-1530dc89-2e43-4092-b276-78fecf4d51ce tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1263397
May 28 14:25:54.785810 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e1529a88-ff10-432a-9919-4bc8b84b799b req-9e63689a-d0bd-45f7-9194-9f5b6fd58dfe tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397654
May 28 14:25:55.044040 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483451', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3521825'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:55.048840 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-939435d5-dc2a-4ac4-b354-e38335ff2dc7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:55.118801 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Pushing event updated for resources: {'Subnet': ['ID=31bcc630-98a7-46cc-9928-64d7da56d404,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:55.124174 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:55.126575 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Checking segment: {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:55.126924 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Network hostable DHCP agents. Network: 780506d2-6c05-4b1f-af1f-a4a3d627ec86, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:25:55.231138 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:25:55.322603 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 780506d2-6c05-4b1f-af1f-a4a3d627ec86) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:55.336481 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-965fd4b3-96fa-47b1-9a51-ba65f942301d None None] Network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:25:55.336942 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:55.336942 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:55.421903 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-c01adae8-e5fd-4c35-8398-a14abf8db491 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 1.0807598
May 28 14:25:55.424831 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34888) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:55.431793 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:25:55.435913 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:25:55.440044 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Usage tracker for resource:router and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:25:55.443096 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:25:55.449002 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:25:55.506704 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:55.507764 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:55.523024 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:55.547791 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:25:55.548610 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:55.703353 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Allocated IP 172.20.0.2 (780506d2-6c05-4b1f-af1f-a4a3d627ec86/31bcc630-98a7-46cc-9928-64d7da56d404/f486e033-b073-48b8-9c5f-d7ad8479d312) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:55.848934 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:55.918025 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:55.929104 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Transition to ACTIVE for port object f486e033-b073-48b8-9c5f-d7ad8479d312 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:55.947944 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Transition to ACTIVE for port object f486e033-b073-48b8-9c5f-d7ad8479d312 will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:56.022043 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb req-c4ce0c22-3a3a-47eb-9e07-8579b8c96c36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:56.023683 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb req-c4ce0c22-3a3a-47eb-9e07-8579b8c96c36 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1072972
May 28 14:25:56.069672 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e7e25d03-304b-4b6b-8546-dfd2b51f99cb req-1b69d953-3009-4449-b831-da428f35f8b8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388370
May 28 14:25:56.072742 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:56.080544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:56.157632 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:56.160667 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:56.164577 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:56.208975 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Pushing event updated for resources: {'Port': ['ID=f486e033-b073-48b8-9c5f-d7ad8479d312,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:56.243262 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:56.277859 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Attempting to bind port f486e033-b073-48b8-9c5f-d7ad8479d312 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:56.278336 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Attempting to bind port f486e033-b073-48b8-9c5f-d7ad8479d312 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:56.279314 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Attempting to bind port f486e033-b073-48b8-9c5f-d7ad8479d312 on network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:56.293368 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 25, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:56.293867 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Checking segment: {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:56.293985 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:56.294907 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Bound using segment: {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:56.295405 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Bound port: f486e033-b073-48b8-9c5f-d7ad8479d312, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:56.295854 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:56.391234 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:56.403991 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] For port f486e033-b073-48b8-9c5f-d7ad8479d312, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:56.407826 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] For port f486e033-b073-48b8-9c5f-d7ad8479d312, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f486e033-b073-48b8-9c5f-d7ad8479d312,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:56.422688 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:56.498965 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:56.500525 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:56.571158 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Allocated IP 172.27.3.117 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/29a95454-108b-456c-bdc1-95ecef6cc5a5) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:25:56.589964 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Pushing event updated for resources: {'Port': ['ID=f486e033-b073-48b8-9c5f-d7ad8479d312,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:56.594561 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:56.816285 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:56.850566 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-861044f9-de18-4475-a6e5-4e5fd6cfab0d req-4c2fbef0-7ec0-4857-8899-4b9f0ee962ac tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:56.852361 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-861044f9-de18-4475-a6e5-4e5fd6cfab0d req-4c2fbef0-7ec0-4857-8899-4b9f0ee962ac tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 945 time: 0.1670566
May 28 14:25:56.922046 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f486e033-b073-48b8-9c5f-d7ad8479d312 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:56.924663 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-861044f9-de18-4475-a6e5-4e5fd6cfab0d req-6dbd3a68-6a67-4e8b-bf4f-e57b38dc7202 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0621998
May 28 14:25:57.005051 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:57.009866 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cfedcbfe-0dfc-4fac-92ee-1ede182681d4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:57.061137 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port f486e033-b073-48b8-9c5f-d7ad8479d312 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:57.070617 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:25:57.072654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:25:57.076420 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:25:57.114079 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Pushing event updated for resources: {'Port': ['ID=29a95454-108b-456c-bdc1-95ecef6cc5a5,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:57.121902 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:57.316810 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c899ff-c827-4f51-bf84-f0b9656de2cd req-a3bc766f-95dd-45ba-ae56-5fae1ac1aee6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:57.319594 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-79c899ff-c827-4f51-bf84-f0b9656de2cd req-a3bc766f-95dd-45ba-ae56-5fae1ac1aee6 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1122236
May 28 14:25:57.380275 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-79c899ff-c827-4f51-bf84-f0b9656de2cd req-d654dda5-c75b-47b8-b282-c8e54bfd5117 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515544
May 28 14:25:57.580812 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24988897-751e-4891-aab9-76fb80b85379 None None] Network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:25:57.611473 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:57.744374 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-6b625955-c792-474a-8587-123fafdad9e1 None None] Provisioning for port f486e033-b073-48b8-9c5f-d7ad8479d312 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:25:57.757424 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-6b625955-c792-474a-8587-123fafdad9e1 None None] Provisioning complete for port f486e033-b073-48b8-9c5f-d7ad8479d312 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:57.757800 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6b625955-c792-474a-8587-123fafdad9e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:57.851376 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:57.937415 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6b625955-c792-474a-8587-123fafdad9e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:57.949853 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:57.976827 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-6b625955-c792-474a-8587-123fafdad9e1 None None] For port f486e033-b073-48b8-9c5f-d7ad8479d312, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f486e033-b073-48b8-9c5f-d7ad8479d312,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:25:58.067498 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6b625955-c792-474a-8587-123fafdad9e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:58.070928 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:58.147132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b625955-c792-474a-8587-123fafdad9e1 None None] Pushing event updated for resources: {'Port': ['ID=f486e033-b073-48b8-9c5f-d7ad8479d312,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:58.156488 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-6b625955-c792-474a-8587-123fafdad9e1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:58.186692 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-380ecb2e-2b96-4b44-b677-252d0cbf92b8 None None] Provisioning complete for port f486e033-b073-48b8-9c5f-d7ad8479d312 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:58.187169 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-380ecb2e-2b96-4b44-b677-252d0cbf92b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:58.314765 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 req-d6bdee6f-970c-461d-b1e5-efadc7758c71 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:58.321624 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 req-d6bdee6f-970c-461d-b1e5-efadc7758c71 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 945 time: 0.1962786
May 28 14:25:58.380142 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-41d5ab4e-6ab4-4f2a-97c5-f2b834bc0b96 req-9ab31164-4d52-4681-85e6-7ceab7b88e17 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0576925
May 28 14:25:58.449649 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Router 68f2234d-46e9-4ac9-862b-d0d654ece63d is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92695) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:25:58.682202 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:25:58.690974 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Sync routers for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:25:58.694649 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664b2efc-cd73-442b-b00c-0649bc9bad40 req-606542fd-aef3-4fca-ad89-fdc00835b9af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:58.696114 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-664b2efc-cd73-442b-b00c-0649bc9bad40 req-606542fd-aef3-4fca-ad89-fdc00835b9af tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.1854255
May 28 14:25:58.701751 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:25:58.702387 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27bd4f0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:58.755015 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-664b2efc-cd73-442b-b00c-0649bc9bad40 req-7a9dbd1f-6e31-47d4-b287-aa9ff1ca8e08 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0511692
May 28 14:25:58.810870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:58.812095 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 3.3855512
May 28 14:25:58.818462 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 34924) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:25:58.872160 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f486e033-b073-48b8-9c5f-d7ad8479d312 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:25:58.897945 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:25:58.950590 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port f486e033-b073-48b8-9c5f-d7ad8479d312 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:25:58.950865 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:59.210644 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27bd4f0>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:25:57Z', 'revision_number': 3, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:25:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:25:59.214801 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Checking router: 68f2234d-46e9-4ac9-862b-d0d654ece63d for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:25:59.215149 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Updating router 68f2234d-46e9-4ac9-862b-d0d654ece63d port 29a95454-108b-456c-bdc1-95ecef6cc5a5 binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:25:59.269729 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:59.472318 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-a4745e23-6c9b-4f31-8769-0ae61c636f33 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:59.473911 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-a4745e23-6c9b-4f31-8769-0ae61c636f33 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.90 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.2366035
May 28 14:25:59.626490 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:59.647159 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Transition to ACTIVE for port object 29a95454-108b-456c-bdc1-95ecef6cc5a5 will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:25:59.679777 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 req-4479e42a-601e-45e5-a0b7-3754810f49af tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:59.682394 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 req-4479e42a-601e-45e5-a0b7-3754810f49af tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 945 time: 0.1509831
May 28 14:25:59.730336 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e7fdf8c9-78e4-47e6-964b-4af31d97d491 req-08566ece-3e1d-4c72-bbd0-b85dfdcc58bc tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414686
May 28 14:25:59.741220 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:59.747930 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:25:59.809987 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-d3ba81b5-5277-4926-b4eb-fe2f1f72b431 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:25:59.809987 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-d3ba81b5-5277-4926-b4eb-fe2f1f72b431 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.90 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 945 time: 0.4057477
May 28 14:25:59.829017 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Attempting to bind port 29a95454-108b-456c-bdc1-95ecef6cc5a5 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:25:59.829207 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Attempting to bind port 29a95454-108b-456c-bdc1-95ecef6cc5a5 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:25:59.829771 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Attempting to bind port 29a95454-108b-456c-bdc1-95ecef6cc5a5 on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:25:59.838676 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff60349c-f764-40dc-8c8a-ec12e3aa415a None None] Pushing event updated for resources: {'Port': ['ID=29a95454-108b-456c-bdc1-95ecef6cc5a5,revision_number=2']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:25:59.841673 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 25, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:25:59.841989 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:25:59.842393 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:59.842774 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:25:59.843275 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Bound port: 29a95454-108b-456c-bdc1-95ecef6cc5a5, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:25:59.843643 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:59.869075 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-ff60349c-f764-40dc-8c8a-ec12e3aa415a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:25:59.920625 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] For port 29a95454-108b-456c-bdc1-95ecef6cc5a5, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:25:59.923605 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] For port 29a95454-108b-456c-bdc1-95ecef6cc5a5, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=29a95454-108b-456c-bdc1-95ecef6cc5a5,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:25:59.993068 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:25:59.998049 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-2853310f-8950-4fb9-87f4-a7c6175acf68 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:00.021140 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1a61d572-b437-4e2a-ab9e-7bcaf23fc24b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:00.072724 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:00.073263 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:26:00.073875 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27bd4f0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:25:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:00.083096 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Deleting port a600bf0f-8706-4c30-ae48-005a0b8b9b84 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:26:00.083437 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:00.137834 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff60349c-f764-40dc-8c8a-ec12e3aa415a None None] Pushing event updated for resources: {'Port': ['ID=29a95454-108b-456c-bdc1-95ecef6cc5a5,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:00.151842 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-ff60349c-f764-40dc-8c8a-ec12e3aa415a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:00.256664 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:26:00.263002 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb2c9b95-489d-4865-8512-0f188d82b537 req-27a0f1ab-e715-41ab-9229-97c9b0da2295 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:00.264623 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-eb2c9b95-489d-4865-8512-0f188d82b537 req-27a0f1ab-e715-41ab-9229-97c9b0da2295 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 945 time: 0.3730946
May 28 14:26:00.320826 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Deleting port 5e55d283-7678-4380-b5d1-eda7730dd76b {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:26:00.321168 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:00.407471 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] For port a600bf0f-8706-4c30-ae48-005a0b8b9b84, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a600bf0f-8706-4c30-ae48-005a0b8b9b84,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:00.407847 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:00.552111 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27bd4f0>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:25:57Z', 'revision_number': 3, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:25:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:00.556060 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-286a9215-28d2-4205-bb48-446afa72ee9f None None] The sync data for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi is: [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:25:57Z', 'revision_number': 3, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:25:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:26:00.622040 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Calling delete_port for a600bf0f-8706-4c30-ae48-005a0b8b9b84 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:26:00.636807 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-eb2c9b95-489d-4865-8512-0f188d82b537 req-cead6f3c-89e8-4f6b-b301-101c657ee3f1 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/security-groups?id=7540dcc9-66fd-4ce4-a5e7-2759de1432be&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3608282
May 28 14:26:00.764437 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] For port 5e55d283-7678-4380-b5d1-eda7730dd76b, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=5e55d283-7678-4380-b5d1-eda7730dd76b,segment=NetworkSegment(89622796-8108-4109-9bba-4e78e65fc59e),segment_id=89622796-8108-4109-9bba-4e78e65fc59e)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:00.764874 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:00.779083 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Allocated IP 172.20.0.1 (780506d2-6c05-4b1f-af1f-a4a3d627ec86/31bcc630-98a7-46cc-9928-64d7da56d404/4b557829-b439-4d08-8b5d-bd878143e67f) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:26:00.939573 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Calling delete_port for 5e55d283-7678-4380-b5d1-eda7730dd76b owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:26:01.267713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:01.279305 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a req-5408245b-9cae-46e6-a3a6-b0a2e085a585 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:01.280916 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a req-5408245b-9cae-46e6-a3a6-b0a2e085a585 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 945 time: 0.3532646
May 28 14:26:01.343716 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Transition to ACTIVE for port object 4b557829-b439-4d08-8b5d-bd878143e67f will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:01.469508 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:01.484230 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-552be166-3ee3-46e5-9236-15d1944a76b9 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:01.484553 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['a600bf0f-8706-4c30-ae48-005a0b8b9b84'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:26:01.542038 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Pushing event deleted for resources: {'Port': ['ID=a600bf0f-8706-4c30-ae48-005a0b8b9b84,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:01.546212 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3bab4f7f-4cbb-4d4f-afcd-b4565351e69a req-0a0ae0b6-d323-4e2a-81fb-e793f16093cc tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/security-groups?id=0ae740c4-c94e-4bac-9fd6-dc3f96091cac&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2574334
May 28 14:26:01.548051 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:01.637329 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] No DVR routers for this DVR port a600bf0f-8706-4c30-ae48-005a0b8b9b84 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:26:01.640465 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:01.642994 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c17d712-c03d-44ac-bd8d-5f9b99160b0f', 'name': 'network-vif-deleted', 'tag': 'a600bf0f-8706-4c30-ae48-005a0b8b9b84'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:26:01.656336 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:01.663931 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:01.673352 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['5e55d283-7678-4380-b5d1-eda7730dd76b'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:26:01.713733 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Pushing event deleted for resources: {'Port': ['ID=5e55d283-7678-4380-b5d1-eda7730dd76b,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:01.718705 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:01.749823 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c17d712-c03d-44ac-bd8d-5f9b99160b0f', 'name': 'network-vif-deleted', 'tag': 'a600bf0f-8706-4c30-ae48-005a0b8b9b84', 'status': 'completed', 'code': 200}
May 28 14:26:01.760751 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:01.770674 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-41a6c0ea-1d49-4788-a087-011b14adadbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:01.860264 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d63f8dbb-479d-4d85-9a40-06730dd09594 req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.90 "DELETE /v2.0/ports/a600bf0f-8706-4c30-ae48-005a0b8b9b84 HTTP/1.1" status: 204  len: 173 time: 2.3363800
May 28 14:26:01.911838 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] No DVR routers for this DVR port 5e55d283-7678-4380-b5d1-eda7730dd76b on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:26:01.931281 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:01.933290 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c30a0d12-9f1d-4be1-8982-f8ea4b2ef645 req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.90 "DELETE /v2.0/ports/5e55d283-7678-4380-b5d1-eda7730dd76b HTTP/1.1" status: 204  len: 173 time: 2.1079705
May 28 14:26:01.943080 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:26:01.946084 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-fdb18f81-00d4-4415-ae5a-b64548d0e281 req-dac86b95-7e3d-4167-8ca7-53dec35bdef8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Synchronizing usage tracker for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:26:01.952229 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:01.956190 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:26:02.000880 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Pushing event updated for resources: {'Port': ['ID=4b557829-b439-4d08-8b5d-bd878143e67f,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:02.008023 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:02.030081 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:02.153108 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-fdb18f81-00d4-4415-ae5a-b64548d0e281 req-dac86b95-7e3d-4167-8ca7-53dec35bdef8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Unset dirty status for tenant:71fbb9d6a3b643238579cd1698ca83e1 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:26:02.154955 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fdb18f81-00d4-4415-ae5a-b64548d0e281 req-dac86b95-7e3d-4167-8ca7-53dec35bdef8 tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] 10.222.0.59 "GET /v2.0/ports?device_id=9c17d712-c03d-44ac-bd8d-5f9b99160b0f HTTP/1.1" status: 200  len: 210 time: 0.3143587
May 28 14:26:02.273003 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-3053c6a0-2990-4dee-bea5-162c2126fa34 None None] Provisioning for port 4b557829-b439-4d08-8b5d-bd878143e67f completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:02.278050 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-3053c6a0-2990-4dee-bea5-162c2126fa34 None None] Provisioning complete for port 4b557829-b439-4d08-8b5d-bd878143e67f triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:02.279057 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3053c6a0-2990-4dee-bea5-162c2126fa34 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:02.285405 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:02.349983 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-3053c6a0-2990-4dee-bea5-162c2126fa34 None None] Port 4b557829-b439-4d08-8b5d-bd878143e67f cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:26:02.496124 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:02.540797 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:02.575765 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-5165ea9a-08e9-498f-bd32-1eba1afc3153 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:02.631153 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:02.664193 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-98a74fa2-da23-4460-81ae-33f49054c82b tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:02.720874 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-301001e6-12f2-4fdf-8290-cad447729c29 req-fb1b4373-09c9-4a6e-ac15-94f59fe9b536 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] 10.222.0.59 "GET /v2.0/ports?device_id=27eed777-874a-4f63-898a-6d4f77aef89d HTTP/1.1" status: 200  len: 210 time: 0.0455561
May 28 14:26:02.746366 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Pushing event updated for resources: {'Port': ['ID=4b557829-b439-4d08-8b5d-bd878143e67f,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:02.748723 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:02.752419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:02.898932 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:26:02.900559 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:02.905796 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 29a95454-108b-456c-bdc1-95ecef6cc5a5 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:03.119323 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 29a95454-108b-456c-bdc1-95ecef6cc5a5 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:03.127971 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 29a95454-108b-456c-bdc1-95ecef6cc5a5 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:03.128536 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:03.148336 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Router 68f2234d-46e9-4ac9-862b-d0d654ece63d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:26:03.198056 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-c16fd988-4dd0-4271-a511-140ed727c1e4 None None] Provisioning complete for port 4b557829-b439-4d08-8b5d-bd878143e67f triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:03.198428 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c16fd988-4dd0-4271-a511-140ed727c1e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:03.271039 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 34966) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:03.285303 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-c16fd988-4dd0-4271-a511-140ed727c1e4 None None] Port 4b557829-b439-4d08-8b5d-bd878143e67f cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:26:03.316180 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:03.334540 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 29a95454-108b-456c-bdc1-95ecef6cc5a5, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=29a95454-108b-456c-bdc1-95ecef6cc5a5,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:03.348333 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:26:03.353190 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] 10.222.0.59 "PUT /v2.0/routers/68f2234d-46e9-4ac9-862b-d0d654ece63d/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.5372243
May 28 14:26:03.366296 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Sync routers for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:26:03.376187 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:26:03.376836 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba23c4df0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:26:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:03.449518 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:03.458618 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-6b625955-c792-474a-8587-123fafdad9e1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:03.656422 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=29a95454-108b-456c-bdc1-95ecef6cc5a5,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:03.668295 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.668762 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.669861 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.670321 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.671679 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.672075 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.672417 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.672751 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.673086 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.673457 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.673732 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.674053 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:03.680006 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:03.697845 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:26:03.750952 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27eed777-874a-4f63-898a-6d4f77aef89d', 'name': 'network-vif-deleted', 'tag': '5e55d283-7678-4380-b5d1-eda7730dd76b'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:26:03.756480 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:03.808632 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '27eed777-874a-4f63-898a-6d4f77aef89d', 'name': 'network-vif-deleted', 'tag': '5e55d283-7678-4380-b5d1-eda7730dd76b', 'status': 'completed', 'code': 200}
May 28 14:26:04.003858 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-681900'] for router_interface, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:04.097292 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba23c4df0>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '4b557829-b439-4d08-8b5d-bd878143e67f', 'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'mac_address': 'fa:16:3e:db:9f:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:00Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 2, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'subnets': [{'id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:04.102778 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Checking router: 68f2234d-46e9-4ac9-862b-d0d654ece63d for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:26:04.103817 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Updating router 68f2234d-46e9-4ac9-862b-d0d654ece63d port 4b557829-b439-4d08-8b5d-bd878143e67f binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:26:04.172836 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 5e55d283-7678-4380-b5d1-eda7730dd76b no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:26:04.228550 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 5e55d283-7678-4380-b5d1-eda7730dd76b {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:26:04.229065 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 5e55d283-7678-4380-b5d1-eda7730dd76b not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:26:04.229910 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device a600bf0f-8706-4c30-ae48-005a0b8b9b84 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:26:04.269803 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: a600bf0f-8706-4c30-ae48-005a0b8b9b84 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:26:04.270301 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device a600bf0f-8706-4c30-ae48-005a0b8b9b84 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:26:04.273986 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:04.498872 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Deleting port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:26:04.499376 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:04.520234 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 35000) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:04.525985 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1005813024-network', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:04.531479 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:04.552314 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Usage tracker for resource:network and tenant:0be9be1321f244bc94c24f456fb7c525 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:26:04.552314 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:26:04.552314 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:04.630119 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] For port f9a61c41-ea07-4db2-b3e3-2d40ecdec76d, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f9a61c41-ea07-4db2-b3e3-2d40ecdec76d,segment=NetworkSegment(ceb4fcf2-0e82-4e08-b47f-4114a006cbb3),segment_id=ceb4fcf2-0e82-4e08-b47f-4114a006cbb3)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:04.630475 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:04.698663 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:04.712922 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Transition to ACTIVE for port object 4b557829-b439-4d08-8b5d-bd878143e67f will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:04.732624 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Made reservation on behalf of 0be9be1321f244bc94c24f456fb7c525 for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:26:04.735191 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:04.753837 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:04.756302 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Calling delete_port for f9a61c41-ea07-4db2-b3e3-2d40ecdec76d owned by network:router_interface {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:26:04.776130 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:04.799274 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Usage tracker for resource:security_group_rule and tenant:0be9be1321f244bc94c24f456fb7c525 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:26:04.808141 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:26:04.820070 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:04.866071 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 29a95454-108b-456c-bdc1-95ecef6cc5a5 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:04.897399 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:04.908833 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:04.999041 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.101553 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.104600 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9480888e-5ff5-4a74-84b3-bafbd7cefdc0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:05.152496 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] vlan segment allocate from pool success with {'vlan_id': 897, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:26:05.160766 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ee698d3-c038-4ff2-ac70-843152d2a174,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:05.170961 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:05.180308 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b462502-0488-4619-ad5c-9a272614279a None None] Pushing event updated for resources: {'Port': ['ID=4b557829-b439-4d08-8b5d-bd878143e67f,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:05.180481 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.180481 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Added segment 383d4e28-523c-4ae9-8c2d-d39a2f2756c4 of type vlan for network 80af2296-81e4-47a9-b767-e8d04b07bbce
May 28 14:26:05.225109 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.257235 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-0b462502-0488-4619-ad5c-9a272614279a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.348s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:05.293029 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 29a95454-108b-456c-bdc1-95ecef6cc5a5 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:05.293407 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.314216 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.323849 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e1bf8849-3d12-4281-ac47-3bd7c4eb4b9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:05.330778 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Attempting to bind port 4b557829-b439-4d08-8b5d-bd878143e67f on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:26:05.331155 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Attempting to bind port 4b557829-b439-4d08-8b5d-bd878143e67f by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:26:05.331521 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Attempting to bind port 4b557829-b439-4d08-8b5d-bd878143e67f on network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:26:05.351673 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.351843 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 26, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:26:05.359198 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Checking segment: {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:26:05.359198 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.359198 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Bound using segment: {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:26:05.359782 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:05.360218 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Bound port: 4b557829-b439-4d08-8b5d-bd878143e67f, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:26:05.360218 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.360376 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.361879 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:05.535720 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Pushing event deleted for resources: {'Port': ['ID=f9a61c41-ea07-4db2-b3e3-2d40ecdec76d,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:05.542459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:05.554040 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.573935 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Pushing event updated for resources: {'Network': ['ID=80af2296-81e4-47a9-b767-e8d04b07bbce,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:05.577540 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:05.593968 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] For port 4b557829-b439-4d08-8b5d-bd878143e67f, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:26:05.597295 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 80af2296-81e4-47a9-b767-e8d04b07bbce details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:26:05.636892 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] For port 4b557829-b439-4d08-8b5d-bd878143e67f, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=4b557829-b439-4d08-8b5d-bd878143e67f,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:26:05.702715 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 1.1812422
May 28 14:26:05.705489 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35024) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:05.711581 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Request body: {'subnet': {'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1005813024-subnet', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:05.718166 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:05.722686 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Usage tracker for resource:subnet and tenant:0be9be1321f244bc94c24f456fb7c525 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:26:05.725877 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:26:05.732591 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:05.764988 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.769782 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:05.838378 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Made reservation on behalf of 0be9be1321f244bc94c24f456fb7c525 for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:26:05.840813 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3521847'] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:05.845935 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:26:05.847626 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba23c4df0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:26:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:05.916702 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b462502-0488-4619-ad5c-9a272614279a None None] Pushing event updated for resources: {'Port': ['ID=4b557829-b439-4d08-8b5d-bd878143e67f,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:05.922429 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-0b462502-0488-4619-ad5c-9a272614279a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:06.092905 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:26:06.301919 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551923', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-685116'] for router_interface, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:06.475572 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba23c4df0>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '4b557829-b439-4d08-8b5d-bd878143e67f', 'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'mac_address': 'fa:16:3e:db:9f:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:00Z', 'updated_at': '2021-05-28T14:26:05Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'subnets': [{'id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:06.481103 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d0b6b6b-c6d2-4c71-9f42-0579e93395c4 None None] The sync data for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi is: [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '4b557829-b439-4d08-8b5d-bd878143e67f', 'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'mac_address': 'fa:16:3e:db:9f:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:00Z', 'updated_at': '2021-05-28T14:26:05Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'subnets': [{'id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:26:06.815667 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:26:06.979340 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 4b557829-b439-4d08-8b5d-bd878143e67f up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:07.020470 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483451', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3521825'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.048686 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:07.143219 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:26:07.150364 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Pushing event updated for resources: {'Subnet': ['ID=e337430b-91ab-4713-a867-a6459ba34606,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:07.152170 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] Sync routers for ids ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:26:07.153256 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:07.158965 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Checking segment: {'id': '383d4e28-523c-4ae9-8c2d-d39a2f2756c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:26:07.159334 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Network hostable DHCP agents. Network: 80af2296-81e4-47a9-b767-e8d04b07bbce, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:26:07.163844 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] Routers {'8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:26:07.164134 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 4b557829-b439-4d08-8b5d-bd878143e67f completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:07.164968 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba31ccb50>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:26:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:07.176302 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 4b557829-b439-4d08-8b5d-bd878143e67f triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:07.176988 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.272818 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 35050) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:07.277818 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] 10.222.0.59 "PUT /v2.0/routers/8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 4.0054543
May 28 14:26:07.288727 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Network 80af2296-81e4-47a9-b767-e8d04b07bbce is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:26:07.370086 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 80af2296-81e4-47a9-b767-e8d04b07bbce) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:07.380518 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-966f501f-5039-40a3-96c3-495a7d29e484 None None] Network 80af2296-81e4-47a9-b767-e8d04b07bbce requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:26:07.382274 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:07.383300 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.484829 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.7782207
May 28 14:26:07.494610 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 35068) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:07.501296 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:07.512184 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:07.521964 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Usage tracker for resource:router and tenant:0be9be1321f244bc94c24f456fb7c525 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:26:07.526022 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:26:07.543057 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:07.554983 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] Set router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:26:07.574508 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.659972 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 4b557829-b439-4d08-8b5d-bd878143e67f, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=4b557829-b439-4d08-8b5d-bd878143e67f,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:07.675712 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.678623 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.722653 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.765599 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.767806 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:07.801784 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-80af2296-81e4-47a9-b767-e8d04b07bbce', 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'fixed_ips': [{'subnet_id': 'e337430b-91ab-4713-a867-a6459ba34606'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:26:07.802965 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.904439 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba31ccb50>, [{'id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155'}], 'enable_snat': True}, 'gw_port_id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:08Z', 'updated_at': '2021-05-28T14:26:05Z', 'revision_number': 5, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'gw_port': {'id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:7a:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:10Z', 'updated_at': '2021-05-28T14:21:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:07.913202 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] Checking router: 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:26:07.924774 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] Routers {'8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:26:07.925631 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba31ccb50>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:26:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:07.930753 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks [] for router, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:07.937761 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=4b557829-b439-4d08-8b5d-bd878143e67f,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:07.943899 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:08.036683 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Allocated IP 172.20.0.2 (80af2296-81e4-47a9-b767-e8d04b07bbce/e337430b-91ab-4713-a867-a6459ba34606/02ea7bcd-9a38-4a91-99c6-f34511237d89) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:26:08.174782 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] Set router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:26:08.299017 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:08.312184 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Transition to ACTIVE for port object 02ea7bcd-9a38-4a91-99c6-f34511237d89 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:08.354921 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Transition to ACTIVE for port object 02ea7bcd-9a38-4a91-99c6-f34511237d89 will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:08.360182 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:08.377240 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:08.473610 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba31ccb50>, [{'id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155'}], 'enable_snat': True}, 'gw_port_id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:08Z', 'updated_at': '2021-05-28T14:26:05Z', 'revision_number': 5, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'gw_port': {'id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:7a:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:10Z', 'updated_at': '2021-05-28T14:21:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:08.477385 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ce9689-6e01-4836-8d1e-c9fbf29e3a6d None None] The sync data for ids ['8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46'] in dv-cinder-791281-3-iscsi is: [{'id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'name': 'tempest-ServerRescueNegativeTestJSON-1248026511-router', 'tenant_id': '71fbb9d6a3b643238579cd1698ca83e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155'}], 'enable_snat': True}, 'gw_port_id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:08Z', 'updated_at': '2021-05-28T14:26:05Z', 'revision_number': 5, 'project_id': '71fbb9d6a3b643238579cd1698ca83e1', 'gw_port': {'id': '71ca7b78-f58e-42f2-b5dc-e78d77a8801c', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:7a:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:10Z', 'updated_at': '2021-05-28T14:21:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:26:08.741559 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:08.745572 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:08.808381 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Network 80af2296-81e4-47a9-b767-e8d04b07bbce is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:26:08.811326 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:08.816315 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:26:08.821100 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Pushing event updated for resources: {'Port': ['ID=02ea7bcd-9a38-4a91-99c6-f34511237d89,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:08.825563 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:08.919728 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 4b557829-b439-4d08-8b5d-bd878143e67f up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:08.967841 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Attempting to bind port 02ea7bcd-9a38-4a91-99c6-f34511237d89 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:26:08.968220 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Attempting to bind port 02ea7bcd-9a38-4a91-99c6-f34511237d89 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '383d4e28-523c-4ae9-8c2d-d39a2f2756c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:26:08.968591 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Attempting to bind port 02ea7bcd-9a38-4a91-99c6-f34511237d89 on network 80af2296-81e4-47a9-b767-e8d04b07bbce {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:26:08.981928 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 26, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:26:08.982404 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Checking segment: {'id': '383d4e28-523c-4ae9-8c2d-d39a2f2756c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:26:08.982708 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:08.983105 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Bound using segment: {'id': '383d4e28-523c-4ae9-8c2d-d39a2f2756c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:26:08.983983 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Bound port: 02ea7bcd-9a38-4a91-99c6-f34511237d89, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '383d4e28-523c-4ae9-8c2d-d39a2f2756c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:26:08.983983 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:08.997698 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Deleting port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:26:08.997698 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:09.078271 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 4b557829-b439-4d08-8b5d-bd878143e67f triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:09.078715 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:09.134824 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] For port 02ea7bcd-9a38-4a91-99c6-f34511237d89, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:26:09.147667 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] For port 02ea7bcd-9a38-4a91-99c6-f34511237d89, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=02ea7bcd-9a38-4a91-99c6-f34511237d89,segment=NetworkSegment(383d4e28-523c-4ae9-8c2d-d39a2f2756c4),segment_id=383d4e28-523c-4ae9-8c2d-d39a2f2756c4)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:26:09.218223 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f9a61c41-ea07-4db2-b3e3-2d40ecdec76d no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:26:09.255342 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: f9a61c41-ea07-4db2-b3e3-2d40ecdec76d {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:26:09.255728 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f9a61c41-ea07-4db2-b3e3-2d40ecdec76d not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:26:09.267287 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:09.271211 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-8c1c74ec-3e62-4e4e-95b2-810b4a4cef05 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:09.351330 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] For port 71ca7b78-f58e-42f2-b5dc-e78d77a8801c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=71ca7b78-f58e-42f2-b5dc-e78d77a8801c,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:09.351717 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:09.351831 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Pushing event updated for resources: {'Port': ['ID=02ea7bcd-9a38-4a91-99c6-f34511237d89,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:09.355107 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:09.514413 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Calling delete_port for 71ca7b78-f58e-42f2-b5dc-e78d77a8801c owned by network:router_gateway {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:26:09.542458 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:09.584698 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:09.882679 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Allocated IP 172.27.3.188 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/6f781748-253f-45fc-bd6d-1066450d3a1a) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:26:10.052529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:10.060644 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-7448fe6a-d47c-41a5-8933-d4cd58e66a8e tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:10.152302 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Pushing event deleted for resources: {'Port': ['ID=71ca7b78-f58e-42f2-b5dc-e78d77a8801c,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:10.162163 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:10.250483 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89fe82f8-fb48-4e16-910b-04090fad48a1 None None] Network 80af2296-81e4-47a9-b767-e8d04b07bbce requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:26:10.306242 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-682161'] for router_gateway, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:10.411529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:10.452570 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-4aa2c2d2-b4f5-4dc1-b9d3-130473187fd6 None None] Provisioning for port 02ea7bcd-9a38-4a91-99c6-f34511237d89 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:10.488757 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-685628', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31078'] for router, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:10.491480 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:10.712685 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-684032'] for router, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:10.713288 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 {{(pid=92695) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 28 14:26:10.735518 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:10.735518 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] 10.222.0.59 "DELETE /v2.0/routers/8d2b8f49-6be4-4fd8-a6df-1cb061ca3a46 HTTP/1.1" status: 204  len: 168 time: 3.4560544
May 28 14:26:10.735518 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:10.735821 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35096) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:10.736196 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:10.813711 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:26:10.817965 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:10.822533 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:26:10.834345 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_v2 [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] Deleting subnet 741b5b05-e852-43d4-a973-49d123a472b9 {{(pid=92694) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:26:10.837969 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:10.978995 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Pushing event updated for resources: {'Port': ['ID=6f781748-253f-45fc-bd6d-1066450d3a1a,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:10.983840 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:11.041464 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1655020'] for subnet, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.097945 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.329289 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 02ea7bcd-9a38-4a91-99c6-f34511237d89 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:11.442431 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3483512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3521832'] for subnet, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.446550 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c1c0ffed-c79f-44f0-be93-0ae947053aa5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:11.470693 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 02ea7bcd-9a38-4a91-99c6-f34511237d89 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:11.475925 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 02ea7bcd-9a38-4a91-99c6-f34511237d89 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:11.476291 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.482514 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=741b5b05-e852-43d4-a973-49d123a472b9,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:11.485681 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:11.486120 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.486750 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.495689 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/741b5b05-e852-43d4-a973-49d123a472b9 HTTP/1.1" status: 204  len: 168 time: 0.7583394
May 28 14:26:11.495902 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35102) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:11.611783 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.612833 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.651185 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 02ea7bcd-9a38-4a91-99c6-f34511237d89, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=02ea7bcd-9a38-4a91-99c6-f34511237d89,segment=NetworkSegment(383d4e28-523c-4ae9-8c2d-d39a2f2756c4),segment_id=383d4e28-523c-4ae9-8c2d-d39a2f2756c4)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:11.718761 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.723694 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:11.753120 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.767437 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba0fe4e50>,) {'filters': {'network_id': ['1145a91e-035d-40fe-813b-06d960bbe8ad']}} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:11.782123 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0fe4e50>, 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3') {'for_net_delete': True} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:11.782546 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0fe4e50>, 'ceb4fcf2-0e82-4e08-b47f-4114a006cbb3') {} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:11.797950 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1655015'] for segment, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.815463 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.821731 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Releasing vlan 850 on physical network physnet1 to pool {{(pid=92694) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:26:11.822139 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3422942'] for segment, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.823670 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=02ea7bcd-9a38-4a91-99c6-f34511237d89,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:11.827788 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]: Traceback (most recent call last):
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     timer()
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     cb(*args, **kw)
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     return func(*args, **kwargs)
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     self._notify()
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     self.callback(batched_events)
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     event.method(event)
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     return f(self, *a, **k)
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._get(url).json()
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self.request(url, 'GET', **kwargs)
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:26:11.836131 dv-cinder-791281-3-iscsi neutron-server[92694]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:26:11.869159 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.980028 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:11.988441 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-17488971-f1ee-45ac-a917-df2ae66c792d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:12.002855 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:12.015418 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Pushing event deleted for resources: {'Network': ['ID=1145a91e-035d-40fe-813b-06d960bbe8ad,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:12.018636 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:12.083178 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-df436876-2b2b-4935-a5c9-3747c3069aa6 admin admin] 10.222.0.59 "DELETE /v2.0/networks/1145a91e-035d-40fe-813b-06d960bbe8ad HTTP/1.1" status: 204  len: 168 time: 0.5862339
May 28 14:26:12.238087 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Router 0f40bc76-0322-44d2-a3d8-f60c99809582 is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92695) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:26:12.420937 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:26:12.430337 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Sync routers for ids ['0f40bc76-0322-44d2-a3d8-f60c99809582'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:26:12.439191 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Routers {'0f40bc76-0322-44d2-a3d8-f60c99809582'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:26:12.439838 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba183d1f0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:26:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0f40bc76-0322-44d2-a3d8-f60c99809582'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:12.539682 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:12.540884 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 5.0451221
May 28 14:26:12.543631 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 35116) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:12.619203 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Set router 0f40bc76-0322-44d2-a3d8-f60c99809582 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:26:12.684847 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35124) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:12.740507 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-fa82bc3a-5a9f-4474-af64-c885f50dfe44 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=71fbb9d6a3b643238579cd1698ca83e1&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0542622
May 28 14:26:12.743292 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35128) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:12.812461 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-02938388-ebdd-423a-854e-95afd6136416 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:12.849244 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-02938388-ebdd-423a-854e-95afd6136416 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:12.944285 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 02ea7bcd-9a38-4a91-99c6-f34511237d89 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:13.013797 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-02938388-ebdd-423a-854e-95afd6136416 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.029742 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-837c9424-bcba-4a86-8833-0a0fd3f7b6d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:13.042505 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 02ea7bcd-9a38-4a91-99c6-f34511237d89 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:13.042786 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.048751 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02938388-ebdd-423a-854e-95afd6136416 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7540dcc9-66fd-4ce4-a5e7-2759de1432be,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:13.058331 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-02938388-ebdd-423a-854e-95afd6136416 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:13.088028 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba183d1f0>, [{'id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:26:07Z', 'updated_at': '2021-05-28T14:26:11Z', 'revision_number': 3, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'gw_port': {'id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:87:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:09Z', 'updated_at': '2021-05-28T14:26:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:13.103328 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Checking router: 0f40bc76-0322-44d2-a3d8-f60c99809582 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:26:13.103544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Updating router 0f40bc76-0322-44d2-a3d8-f60c99809582 port 6f781748-253f-45fc-bd6d-1066450d3a1a binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:26:13.133626 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-02938388-ebdd-423a-854e-95afd6136416 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.135705 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-02938388-ebdd-423a-854e-95afd6136416 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7540dcc9-66fd-4ce4-a5e7-2759de1432be HTTP/1.1" status: 204  len: 168 time: 0.3904800
May 28 14:26:13.174990 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.344172 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 71ca7b78-f58e-42f2-b5dc-e78d77a8801c no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:26:13.385917 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 71ca7b78-f58e-42f2-b5dc-e78d77a8801c {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:26:13.386258 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 71ca7b78-f58e-42f2-b5dc-e78d77a8801c not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:26:13.397110 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.615645 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.622524 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Allocated IP 172.20.0.1 (80af2296-81e4-47a9-b767-e8d04b07bbce/e337430b-91ab-4713-a867-a6459ba34606/8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:26:13.630132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Transition to ACTIVE for port object 6f781748-253f-45fc-bd6d-1066450d3a1a will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:13.733686 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.737521 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:13.783279 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.805232 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Transition to ACTIVE for port object 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:13.847976 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Attempting to bind port 6f781748-253f-45fc-bd6d-1066450d3a1a on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:26:13.848391 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Attempting to bind port 6f781748-253f-45fc-bd6d-1066450d3a1a by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:26:13.848722 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Attempting to bind port 6f781748-253f-45fc-bd6d-1066450d3a1a on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:26:13.865544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb8bab08-b956-4625-921d-7dfeed11115b None None] Pushing event updated for resources: {'Port': ['ID=6f781748-253f-45fc-bd6d-1066450d3a1a,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:13.865544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-fb8bab08-b956-4625-921d-7dfeed11115b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:13.865544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 26, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:26:13.865544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:26:13.865544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.865544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:26:13.865544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Bound port: 6f781748-253f-45fc-bd6d-1066450d3a1a, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:26:13.865544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.936393 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:13.938069 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] For port 6f781748-253f-45fc-bd6d-1066450d3a1a, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:26:13.940408 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:13.942000 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] For port 6f781748-253f-45fc-bd6d-1066450d3a1a, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=6f781748-253f-45fc-bd6d-1066450d3a1a,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:26:14.004455 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Network 80af2296-81e4-47a9-b767-e8d04b07bbce is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:26:14.007368 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:14.010730 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:26:14.041227 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Pushing event updated for resources: {'Port': ['ID=8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:14.048017 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:14.071845 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:14.080093 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:14.084357 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:14.187217 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Routers {'0f40bc76-0322-44d2-a3d8-f60c99809582'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:26:14.187966 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba183d1f0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:26:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0f40bc76-0322-44d2-a3d8-f60c99809582'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:14.243758 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb8bab08-b956-4625-921d-7dfeed11115b None None] Pushing event updated for resources: {'Port': ['ID=6f781748-253f-45fc-bd6d-1066450d3a1a,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:14.271473 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-fb8bab08-b956-4625-921d-7dfeed11115b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:14.417909 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] Set router 0f40bc76-0322-44d2-a3d8-f60c99809582 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:26:14.479904 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:14.526646 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-2ed71f21-d288-4b54-b103-ef2fa70534f6 None None] Provisioning for port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:14.546097 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35166) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:14.557143 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-2ed71f21-d288-4b54-b103-ef2fa70534f6 None None] Provisioning complete for port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:14.557677 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2ed71f21-d288-4b54-b103-ef2fa70534f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:14.679974 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-2ed71f21-d288-4b54-b103-ef2fa70534f6 None None] Port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:26:14.691618 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-474175597-network', 'tenant_id': '94dc9f7ad5dd40429991c68c00e7ec6d'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:14.699072 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:14.705637 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Usage tracker for resource:network and tenant:94dc9f7ad5dd40429991c68c00e7ec6d is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:26:14.709511 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:26:14.722358 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:14.790602 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba183d1f0>, [{'id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:26:07Z', 'updated_at': '2021-05-28T14:26:11Z', 'revision_number': 3, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'gw_port': {'id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:87:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:09Z', 'updated_at': '2021-05-28T14:26:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:14.794627 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-996cfd62-1690-405f-9cda-54cfbcca62d8 None None] The sync data for ids ['0f40bc76-0322-44d2-a3d8-f60c99809582'] in dv-cinder-791281-3-iscsi is: [{'id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:26:07Z', 'updated_at': '2021-05-28T14:26:11Z', 'revision_number': 3, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'gw_port': {'id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:87:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:09Z', 'updated_at': '2021-05-28T14:26:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:26:14.803300 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Made reservation on behalf of 94dc9f7ad5dd40429991c68c00e7ec6d for: {'network': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:26:14.803300 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:14.817168 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:14.834555 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:14.838756 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Usage tracker for resource:security_group_rule and tenant:94dc9f7ad5dd40429991c68c00e7ec6d is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:26:14.842629 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:26:14.846494 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:14.848629 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:14.933644 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:14.944436 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:14.974286 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-56469f62-9e2a-4f29-9e92-0e3949ba4a87 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:15.034248 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:15.037712 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c8ff4156-6267-4c14-8e88-361c2608765f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:15.071914 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] vlan segment allocate from pool success with {'vlan_id': 851, 'physical_network': 'physnet1'}  {{(pid=92694) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:26:15.125901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Pushing event updated for resources: {'Port': ['ID=8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:15.128632 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b43869d5-cbfc-463d-bbd2-01c0f44737b1,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:15.137438 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:15.141554 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:15.141894 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.segments_db [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Added segment f9da76d7-4098-4417-923d-48d74a246b67 of type vlan for network 37e18bf5-545d-49a2-afdf-585587a7907f
May 28 14:26:15.145390 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:15.168174 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:15.186503 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:15.311940 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:15.313315 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:15.314129 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:15.328140 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:15.340094 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Network 80af2296-81e4-47a9-b767-e8d04b07bbce is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:26:15.341320 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:15.504398 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Pushing event updated for resources: {'Network': ['ID=37e18bf5-545d-49a2-afdf-585587a7907f,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:15.507593 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:15.517304 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 37e18bf5-545d-49a2-afdf-585587a7907f details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:26:15.559168 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.0114639
May 28 14:26:15.561873 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35190) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:15.569414 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Request body: {'subnet': {'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-474175597-subnet', 'tenant_id': '94dc9f7ad5dd40429991c68c00e7ec6d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:15.577138 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:15.586611 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Usage tracker for resource:subnet and tenant:94dc9f7ad5dd40429991c68c00e7ec6d is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:26:15.589809 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:26:15.601237 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Router 0f40bc76-0322-44d2-a3d8-f60c99809582 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:26:15.604961 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:15.637985 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-2356b101-eda5-46ce-8d10-7d935a7ccf19 None None] Provisioning complete for port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:15.638371 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-2356b101-eda5-46ce-8d10-7d935a7ccf19 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:15.682850 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Made reservation on behalf of 94dc9f7ad5dd40429991c68c00e7ec6d for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:26:15.687013 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3521847'] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:15.703375 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-2356b101-eda5-46ce-8d10-7d935a7ccf19 None None] Port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:26:15.823678 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:26:15.835603 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] 10.222.0.59 "PUT /v2.0/routers/0f40bc76-0322-44d2-a3d8-f60c99809582/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.2886617
May 28 14:26:16.473203 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483451', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3521825'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:16.478276 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:16.542211 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:26:16.553363 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Pushing event updated for resources: {'Subnet': ['ID=a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:16.563033 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:16.570717 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Checking segment: {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:26:16.571072 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Network hostable DHCP agents. Network: 37e18bf5-545d-49a2-afdf-585587a7907f, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:26:16.672396 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Network 37e18bf5-545d-49a2-afdf-585587a7907f is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:26:16.783610 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 37e18bf5-545d-49a2-afdf-585587a7907f) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:16.817675 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd5b40b4-b13f-4a47-9aa9-5301c9d5eec6 None None] Network 37e18bf5-545d-49a2-afdf-585587a7907f requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:26:16.836099 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Sync routers for ids ['0f40bc76-0322-44d2-a3d8-f60c99809582'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:26:16.842875 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:16.843652 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:16.852464 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Routers {'0f40bc76-0322-44d2-a3d8-f60c99809582'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:26:16.853093 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba25c0f10>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:26:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0f40bc76-0322-44d2-a3d8-f60c99809582'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:17.040054 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 6f781748-253f-45fc-bd6d-1066450d3a1a up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:17.153971 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Set router 0f40bc76-0322-44d2-a3d8-f60c99809582 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:26:17.195839 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-3c74e898-951d-4fa2-804d-6e6a8d29bd5c admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.6327839
May 28 14:26:17.606828 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 6f781748-253f-45fc-bd6d-1066450d3a1a completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:17.636423 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 6f781748-253f-45fc-bd6d-1066450d3a1a triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:17.642022 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:17.752140 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bca27244-33e7-478a-aa86-09a856b0ff23 None None] Network 37e18bf5-545d-49a2-afdf-585587a7907f requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:26:17.940381 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba25c0f10>, [{'id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:26:07Z', 'updated_at': '2021-05-28T14:26:14Z', 'revision_number': 4, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'gw_port': {'id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:87:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:09Z', 'updated_at': '2021-05-28T14:26:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c', 'name': '', 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'mac_address': 'fa:16:3e:f4:78:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_interface', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'e337430b-91ab-4713-a867-a6459ba34606', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:13Z', 'updated_at': '2021-05-28T14:26:14Z', 'revision_number': 2, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'subnets': [{'id': 'e337430b-91ab-4713-a867-a6459ba34606', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:17.953284 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Checking router: 0f40bc76-0322-44d2-a3d8-f60c99809582 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:26:17.953957 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Updating router 0f40bc76-0322-44d2-a3d8-f60c99809582 port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:26:18.051225 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:18.360849 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:18.462627 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 6f781748-253f-45fc-bd6d-1066450d3a1a, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=6f781748-253f-45fc-bd6d-1066450d3a1a,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:18.563144 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:18.565380 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b1457afd-4a35-4344-8aca-750672b8466b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:18.786226 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=6f781748-253f-45fc-bd6d-1066450d3a1a,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:18.790533 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:18.937438 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:18.956043 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 6f781748-253f-45fc-bd6d-1066450d3a1a up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:18.982725 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Transition to ACTIVE for port object 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:19.084088 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 6f781748-253f-45fc-bd6d-1066450d3a1a triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:19.084761 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:19.093873 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:19.103745 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:19.476079 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Pushing event updated for resources: {'Port': ['ID=8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:19.484544 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Attempting to bind port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:26:19.485630 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Attempting to bind port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '383d4e28-523c-4ae9-8c2d-d39a2f2756c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:26:19.486090 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Attempting to bind port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c on network 80af2296-81e4-47a9-b767-e8d04b07bbce {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:26:19.497886 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.498414 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.498947 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.499385 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.500096 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.500614 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.501033 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.501617 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.502047 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.502579 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.503130 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.503603 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:19.517170 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.413s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:19.518202 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 26, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:26:19.518684 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Checking segment: {'id': '383d4e28-523c-4ae9-8c2d-d39a2f2756c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:26:19.519199 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:19.519714 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Bound using segment: {'id': '383d4e28-523c-4ae9-8c2d-d39a2f2756c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:26:19.520291 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Bound port: 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '383d4e28-523c-4ae9-8c2d-d39a2f2756c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:26:19.520763 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:19.701443 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] For port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:26:19.704867 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] For port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c,segment=NetworkSegment(383d4e28-523c-4ae9-8c2d-d39a2f2756c4),segment_id=383d4e28-523c-4ae9-8c2d-d39a2f2756c4)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:26:19.793037 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:19.797106 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:19.990034 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Routers {'0f40bc76-0322-44d2-a3d8-f60c99809582'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:26:19.991684 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba25c0f10>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:26:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0f40bc76-0322-44d2-a3d8-f60c99809582'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:20.112834 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Pushing event updated for resources: {'Port': ['ID=8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c,revision_number=4']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:20.135396 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-0f1a1fa9-66d8-4007-be33-536ea1c6f9b9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.338s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:20.460113 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] Set router 0f40bc76-0322-44d2-a3d8-f60c99809582 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:26:20.988614 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba25c0f10>, [{'id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:26:07Z', 'updated_at': '2021-05-28T14:26:14Z', 'revision_number': 4, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'gw_port': {'id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:87:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:09Z', 'updated_at': '2021-05-28T14:26:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c', 'name': '', 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'mac_address': 'fa:16:3e:f4:78:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_interface', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'e337430b-91ab-4713-a867-a6459ba34606', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:13Z', 'updated_at': '2021-05-28T14:26:19Z', 'revision_number': 4, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'subnets': [{'id': 'e337430b-91ab-4713-a867-a6459ba34606', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:20.994578 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d0e2ed4-052c-4a5c-a9a6-58dc164ffd17 None None] The sync data for ids ['0f40bc76-0322-44d2-a3d8-f60c99809582'] in dv-cinder-791281-3-iscsi is: [{'id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:26:07Z', 'updated_at': '2021-05-28T14:26:14Z', 'revision_number': 4, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'gw_port': {'id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:87:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:09Z', 'updated_at': '2021-05-28T14:26:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c', 'name': '', 'network_id': '80af2296-81e4-47a9-b767-e8d04b07bbce', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'mac_address': 'fa:16:3e:f4:78:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_interface', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'e337430b-91ab-4713-a867-a6459ba34606', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:13Z', 'updated_at': '2021-05-28T14:26:19Z', 'revision_number': 4, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'subnets': [{'id': 'e337430b-91ab-4713-a867-a6459ba34606', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:26:23.010843 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:23.181008 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:23.187190 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:23.187836 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:23.334960 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:23.377074 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c,segment=NetworkSegment(383d4e28-523c-4ae9-8c2d-d39a2f2756c4),segment_id=383d4e28-523c-4ae9-8c2d-d39a2f2756c4)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:23.470861 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:23.474752 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:23.667620 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:23.673041 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:24.915023 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:24.996387 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:24.996865 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:27.795268 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c06d17-3671-4230-bad7-4dc932d01958 req-9f075900-1f11-4a66-92ac-32bebeed2f65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:27.799113 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-86c06d17-3671-4230-bad7-4dc932d01958 req-9f075900-1f11-4a66-92ac-32bebeed2f65 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1098 time: 0.1182888
May 28 14:26:27.819201 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:28.076275 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c06d17-3671-4230-bad7-4dc932d01958 req-84164d37-c5be-47e4-8918-90c411e0fba8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:28.077205 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-86c06d17-3671-4230-bad7-4dc932d01958 req-84164d37-c5be-47e4-8918-90c411e0fba8 service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.2542648
May 28 14:26:28.351773 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-86c06d17-3671-4230-bad7-4dc932d01958 req-31b7eae4-9624-4f2d-8950-43829b181565 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 200  len: 1001 time: 0.2672284
May 28 14:26:28.469310 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c06d17-3671-4230-bad7-4dc932d01958 req-b1093b36-e8e0-4a99-9c75-92966149f060 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:28.471674 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-86c06d17-3671-4230-bad7-4dc932d01958 req-b1093b36-e8e0-4a99-9c75-92966149f060 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.1081986
May 28 14:26:28.629576 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c06d17-3671-4230-bad7-4dc932d01958 req-2342655b-9b77-424a-995e-00c0aa24cdd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:28.631722 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-86c06d17-3671-4230-bad7-4dc932d01958 req-2342655b-9b77-424a-995e-00c0aa24cdd8 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1472995
May 28 14:26:28.783614 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-86c06d17-3671-4230-bad7-4dc932d01958 req-9b85e2ac-6b77-47a7-87cf-9422ef3ae2ff service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1413236
May 28 14:26:29.031593 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-86c06d17-3671-4230-bad7-4dc932d01958 req-6f12a7d3-6ed6-4fcb-8da1-9c1f766062d6 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2410707
May 28 14:26:30.301218 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-16ec4f4c-e4f7-4f8f-907e-5855044735d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:32.165273 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-2435e5d2-fc39-407c-9404-012c84cda829 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:32.173312 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-2435e5d2-fc39-407c-9404-012c84cda829 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/networks?id=37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 200  len: 814 time: 0.3262603
May 28 14:26:32.190816 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-82c6f4b7-9b51-4cf8-a0d1-096dceba55cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/quotas/94dc9f7ad5dd40429991c68c00e7ec6d HTTP/1.1" status: 200  len: 375 time: 0.0163984
May 28 14:26:32.255787 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-9e0f6ad1-acb0-4a3d-8f9d-cc0d4971ea51 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0634565
May 28 14:26:32.459881 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-c719c922-a624-42cf-9b26-e2d77d09bd50 service neutron] 10.222.0.59 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2030809
May 28 14:26:32.513319 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:32.542296 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c070ceb0-36db-48b5-b269-e41383d0e105 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:32.610949 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-b6d70707-418a-4370-983b-61a7c7fde432 service neutron] 10.222.0.59 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1502290
May 28 14:26:33.005640 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e97664c8-b75b-493b-bee9-caeaa8f84951 req-0ea92d3e-a0bc-43a2-a8da-59c6a39775d7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 210 time: 0.0990989
May 28 14:26:33.037030 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb req-5519a7fe-9acc-41b0-b1f2-6c55314f2af7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:33.038958 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb req-5519a7fe-9acc-41b0-b1f2-6c55314f2af7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1727211
May 28 14:26:33.104074 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ffe41a3e-945b-43dc-b7f3-9f668deb79eb req-072ee66e-382f-46f5-b25f-989afb079583 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0577476
May 28 14:26:33.308422 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-5a692c8d-f54f-4b10-8a80-a5d9e33c887d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:33.309179 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-5a692c8d-f54f-4b10-8a80-a5d9e33c887d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Synchronizing usage tracker for tenant:cf7193774c754e07a6f683666ab4addf on resource:network {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:26:33.513388 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-5a692c8d-f54f-4b10-8a80-a5d9e33c887d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Unset dirty status for tenant:cf7193774c754e07a6f683666ab4addf on resource:network {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:26:33.514520 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-5a692c8d-f54f-4b10-8a80-a5d9e33c887d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/networks?id=780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 200  len: 814 time: 0.3736787
May 28 14:26:33.539014 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-3b783965-e4c1-4931-918a-2682aed718ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/quotas/cf7193774c754e07a6f683666ab4addf HTTP/1.1" status: 200  len: 375 time: 0.0091476
May 28 14:26:33.637718 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-38a3d471-d9f5-4397-8740-220565ab1e1b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Synchronizing usage tracker for tenant:cf7193774c754e07a6f683666ab4addf on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:26:33.724066 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:33.747193 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-38a3d471-d9f5-4397-8740-220565ab1e1b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Unset dirty status for tenant:cf7193774c754e07a6f683666ab4addf on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:26:33.748562 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-38a3d471-d9f5-4397-8740-220565ab1e1b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=cf7193774c754e07a6f683666ab4addf&fields=id HTTP/1.1" status: 200  len: 302 time: 0.2044525
May 28 14:26:33.950236 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-ea097b98-5d70-46b6-805f-e30284f583a4 service neutron] 10.222.0.59 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1853294
May 28 14:26:34.132335 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-cf4b727f-4ca8-480f-b2df-8fb022f339f3 service neutron] 10.222.0.59 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1629555
May 28 14:26:34.219078 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8757c182-7b05-4355-8525-f54508f57ec2 req-12f071a5-c3e5-4f19-9a00-bf88c5481704 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 210 time: 0.1118913
May 28 14:26:34.457336 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-268df132-0d1e-4b78-aa01-e5b3400c5fed req-611c4b7c-09f5-4ece-a028-555974f335c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:34.459129 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-268df132-0d1e-4b78-aa01-e5b3400c5fed req-611c4b7c-09f5-4ece-a028-555974f335c7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1041822
May 28 14:26:34.522278 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-268df132-0d1e-4b78-aa01-e5b3400c5fed req-11aaeb57-3a0f-4b27-ab21-99f8f3a0eda9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0558212
May 28 14:26:34.546504 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c1d29c0-8249-4ea3-b7af-f6a4c8627cd4 req-2c57b21e-8106-4b02-9c5c-adedb6c45214 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 210 time: 0.0543249
May 28 14:26:35.409500 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:35.430261 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e4087421-f699-4fe2-b215-3b74bed0f246 req-5cc5d06f-e507-448f-b6df-c7e22650471f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 210 time: 0.0535147
May 28 14:26:35.724181 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-62b97820-cb4f-4e21-a1e1-2e706bad4da6 req-d2b1cad4-fa0a-475b-a0af-ba28074951e1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 210 time: 0.0810132
May 28 14:26:35.948653 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b755240-19f5-428a-987e-07c6485990c2 req-53febea9-5d5b-47e8-99ff-f4f54f0b8d61 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:35.950233 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4b755240-19f5-428a-987e-07c6485990c2 req-53febea9-5d5b-47e8-99ff-f4f54f0b8d61 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1268373
May 28 14:26:36.017286 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4b755240-19f5-428a-987e-07c6485990c2 req-5f793522-610b-48f0-ac86-cc5518475fde tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0607316
May 28 14:26:36.586178 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-96141a1a-2936-44af-b186-afdf907f3d3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:36.588232 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-96141a1a-2936-44af-b186-afdf907f3d3c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "GET /v2.0/networks?id=37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 200  len: 814 time: 0.2321517
May 28 14:26:36.606522 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Request body: {'port': {'device_id': '3eac2abf-26a1-4d1d-84ed-ac16a83ef646', 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f', 'admin_state_up': True, 'tenant_id': '94dc9f7ad5dd40429991c68c00e7ec6d'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:36.651644 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-959b35c8-a508-4eee-aaf1-bf76bc17161c req-7d050a4e-30dd-4e9d-9226-4b8bc8a170ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 210 time: 0.0712342
May 28 14:26:36.911651 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1693c88-002e-4859-b72d-0a068e0ae88f req-bb47c6e1-3859-47ca-8713-d7e7def1b98f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 210 time: 0.0645075
May 28 14:26:36.918324 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:36.923442 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Usage tracker for resource:port and tenant:94dc9f7ad5dd40429991c68c00e7ec6d is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:26:36.928841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:26:36.939655 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:37.071964 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Made reservation on behalf of 94dc9f7ad5dd40429991c68c00e7ec6d for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:26:37.071964 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:37.219780 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 req-fbf07111-b41c-486b-ac9c-96ab5a615407 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:37.225160 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 req-fbf07111-b41c-486b-ac9c-96ab5a615407 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0911398
May 28 14:26:37.320883 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dedaafc0-9f0a-4cc6-b2c7-9e2d7ca7c264 req-1b72c721-2781-407d-ba7a-18defe2711d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0933416
May 28 14:26:37.340130 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Allocated IP 172.20.0.7 (37e18bf5-545d-49a2-afdf-585587a7907f/a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e/965a8c13-7f18-4e6d-92f2-16c7c866bcfd) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:26:37.642470 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:37.826376 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-4d0caee4-4b39-4368-aa79-13dc73062fd5 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:37.828610 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-4d0caee4-4b39-4368-aa79-13dc73062fd5 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.90 "GET /v2.0/networks?id=780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 200  len: 814 time: 0.2822456
May 28 14:26:37.835748 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a4c2871f-16c0-4290-80f8-3e18f97d8fd0 req-6f84d059-955f-4b50-a4a9-5a87896e294b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 210 time: 0.0613298
May 28 14:26:37.845787 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'port': {'device_id': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'admin_state_up': True, 'tenant_id': 'cf7193774c754e07a6f683666ab4addf'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:37.855283 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:37.863933 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fc0a0cec-2a3d-43ac-ac04-89587422b6cb tempest-ServerRescueNegativeTestJSON-1832461075 tempest-ServerRescueNegativeTestJSON-1832461075-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:38.021117 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Network 37e18bf5-545d-49a2-afdf-585587a7907f is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:26:38.026664 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:38.048815 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Pushing event updated for resources: {'Port': ['ID=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:38.069111 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:26:38.112284 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.113018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.113018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.113864 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.114366 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.114901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.115350 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.115806 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.116262 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.116748 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.117288 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.117889 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:38.118991 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9e1eab19-7f15-4160-9dfa-8f8c2a378269 req-74c0915b-88e7-4abe-85b4-5d6429a4954e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 210 time: 0.0594125
May 28 14:26:38.130259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:38.170558 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:38.186109 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:38.186721 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:38.198434 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:38.310183 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7089765
May 28 14:26:38.342770 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Request body: {'port': {'device_id': '3eac2abf-26a1-4d1d-84ed-ac16a83ef646', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:38.443861 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Made reservation on behalf of cf7193774c754e07a6f683666ab4addf for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:26:38.447879 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:38.589690 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:38.822292 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7356494b-e195-4769-9db2-f170d66ed3a5 req-7237759f-55ae-413f-9b65-7ea2e228c4fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:38.824208 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7356494b-e195-4769-9db2-f170d66ed3a5 req-7237759f-55ae-413f-9b65-7ea2e228c4fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.3355472
May 28 14:26:38.876578 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Allocated IP 172.20.0.12 (780506d2-6c05-4b1f-af1f-a4a3d627ec86/31bcc630-98a7-46cc-9928-64d7da56d404/164fd7c8-7a57-4285-93ef-c3fdabceb8be) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:26:39.095845 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7356494b-e195-4769-9db2-f170d66ed3a5 req-31c91658-e353-4922-8a5d-7a315bb2baba tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2207098
May 28 14:26:39.124540 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 req-fa6bb7c4-e18d-40c7-a617-219edbda5920 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:39.126105 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 req-fa6bb7c4-e18d-40c7-a617-219edbda5920 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 931 time: 0.1220989
May 28 14:26:39.232417 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 req-26db32e6-46af-4058-9342-d9639f211d04 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:26:39.340227 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-616a8e44-abd4-48df-9909-63e60d528f84 req-85fc1be7-1040-481b-acd3-60221190b40b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 210 time: 0.0613990
May 28 14:26:39.438544 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 req-26db32e6-46af-4058-9342-d9639f211d04 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:26:39.440546 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5993a8ff-afc0-4ba6-b16b-5a68631cc9e6 req-26db32e6-46af-4058-9342-d9639f211d04 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2960434
May 28 14:26:39.555858 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:39.567846 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 965a8c13-7f18-4e6d-92f2-16c7c866bcfd {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:26:39.581768 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:39.585638 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Transition to ACTIVE for port object 164fd7c8-7a57-4285-93ef-c3fdabceb8be will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:39.599712 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Transition to ACTIVE for port object 965a8c13-7f18-4e6d-92f2-16c7c866bcfd will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:39.665107 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:39.669582 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-30d8fc0e-2948-4996-8748-e853c5044ad9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:39.717051 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:39.812401 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:26:39.818371 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Pushing event updated for resources: {'Port': ['ID=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:39.821745 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:39.823895 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:26:39.851470 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:39.851913 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.120s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:40.019775 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'Port': ['ID=164fd7c8-7a57-4285-93ef-c3fdabceb8be,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:40.024062 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:40.033916 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:40.034560 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:40.076657 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Attempting to bind port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:26:40.076992 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Attempting to bind port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:26:40.077404 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Attempting to bind port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd on network 37e18bf5-545d-49a2-afdf-585587a7907f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:26:40.082647 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd on network 37e18bf5-545d-49a2-afdf-585587a7907f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:26:40.083675 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Attempting to bind port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd on network 37e18bf5-545d-49a2-afdf-585587a7907f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:26:40.089115 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 26, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:26:40.089450 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Checking segment: {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:26:40.089882 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Bound using segment: {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:26:40.090303 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Bound port: 965a8c13-7f18-4e6d-92f2-16c7c866bcfd, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:26:40.090650 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:40.106221 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-0502e349-1f8a-4397-9848-1f4213f2b6c2 None None] Provisioning for port 164fd7c8-7a57-4285-93ef-c3fdabceb8be completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:40.116598 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-0502e349-1f8a-4397-9848-1f4213f2b6c2 None None] Provisioning complete for port 164fd7c8-7a57-4285-93ef-c3fdabceb8be triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:40.117279 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0502e349-1f8a-4397-9848-1f4213f2b6c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:40.177993 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.3405590
May 28 14:26:40.178451 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-0502e349-1f8a-4397-9848-1f4213f2b6c2 None None] Port 164fd7c8-7a57-4285-93ef-c3fdabceb8be cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:26:40.210737 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] For port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:26:40.213830 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] For port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:26:40.291809 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:40.297442 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-6010cca8-2a1d-42ed-bd34-3713c07d08d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:40.361731 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:40.362340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:40.363747 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] 10.222.0.90 "PUT /v2.0/ports/965a8c13-7f18-4e6d-92f2-16c7c866bcfd HTTP/1.1" status: 200  len: 1093 time: 2.0269547
May 28 14:26:40.366181 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3eac2abf-26a1-4d1d-84ed-ac16a83ef646', 'tag': '965a8c13-7f18-4e6d-92f2-16c7c866bcfd'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:26:40.398919 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9277198-358d-44c9-bf55-0de7c7aaffca req-0a9ccae0-9af2-4f99-afb4-d1d4e92c79e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:40.403874 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f9277198-358d-44c9-bf55-0de7c7aaffca req-0a9ccae0-9af2-4f99-afb4-d1d4e92c79e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1664717
May 28 14:26:40.403874 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Pushing event updated for resources: {'Port': ['ID=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:40.407368 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:40.477650 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f9277198-358d-44c9-bf55-0de7c7aaffca req-95ec67a0-c9ea-4ded-bddd-5004d6fc8192 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0664356
May 28 14:26:40.569870 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abde60ce-7947-4cfe-9369-fac09c801318 req-74167d9f-99c9-4445-89d5-54037f6c9d13 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:40.571352 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-abde60ce-7947-4cfe-9369-fac09c801318 req-74167d9f-99c9-4445-89d5-54037f6c9d13 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.0921736
May 28 14:26:40.620095 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3eac2abf-26a1-4d1d-84ed-ac16a83ef646', 'tag': '965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'status': 'completed', 'code': 200}
May 28 14:26:40.644470 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-abde60ce-7947-4cfe-9369-fac09c801318 req-435f6cea-2bf1-4b32-9184-c6e1c8ba8ace tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0663080
May 28 14:26:40.807779 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc32d66c-54eb-471f-8e41-200b027650bd req-83c90f56-dbc4-4db5-b978-1e04cb67aac7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:40.808640 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-fc32d66c-54eb-471f-8e41-200b027650bd req-83c90f56-dbc4-4db5-b978-1e04cb67aac7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:26:40.910839 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-fc32d66c-54eb-471f-8e41-200b027650bd req-83c90f56-dbc4-4db5-b978-1e04cb67aac7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:26:40.912057 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fc32d66c-54eb-471f-8e41-200b027650bd req-83c90f56-dbc4-4db5-b978-1e04cb67aac7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.1861434
May 28 14:26:40.957808 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fc32d66c-54eb-471f-8e41-200b027650bd req-c997fe10-643e-46f6-9278-10429891223e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396802
May 28 14:26:41.685497 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d02427-af98-40f7-87c8-2c85f61490ba req-a940c349-2c26-441e-90d3-e0befdfcc17b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:41.687024 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b2d02427-af98-40f7-87c8-2c85f61490ba req-a940c349-2c26-441e-90d3-e0befdfcc17b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1045341
May 28 14:26:41.739749 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b2d02427-af98-40f7-87c8-2c85f61490ba req-75880c42-07e3-4c53-a7da-d16eb874401d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0467606
May 28 14:26:41.847458 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ababa986-6dd6-44c2-b731-6b8cb55e40ab req-162053d7-1904-498e-9b88-62b75c6ab03b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:41.848169 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-ababa986-6dd6-44c2-b731-6b8cb55e40ab req-162053d7-1904-498e-9b88-62b75c6ab03b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Synchronizing usage tracker for tenant:cf7193774c754e07a6f683666ab4addf on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:26:41.927899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-ababa986-6dd6-44c2-b731-6b8cb55e40ab req-162053d7-1904-498e-9b88-62b75c6ab03b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Unset dirty status for tenant:cf7193774c754e07a6f683666ab4addf on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:26:41.928991 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ababa986-6dd6-44c2-b731-6b8cb55e40ab req-162053d7-1904-498e-9b88-62b75c6ab03b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.1718216
May 28 14:26:41.973900 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-ababa986-6dd6-44c2-b731-6b8cb55e40ab req-4691fe9a-65f6-4957-8905-e2f1978bba87 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Synchronizing usage tracker for tenant:cf7193774c754e07a6f683666ab4addf on resource:security_group {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:26:42.076299 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-ababa986-6dd6-44c2-b731-6b8cb55e40ab req-4691fe9a-65f6-4957-8905-e2f1978bba87 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Unset dirty status for tenant:cf7193774c754e07a6f683666ab4addf on resource:security_group {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:26:42.077747 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ababa986-6dd6-44c2-b731-6b8cb55e40ab req-4691fe9a-65f6-4957-8905-e2f1978bba87 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1422398
May 28 14:26:42.162537 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 req-dd812c1a-f5d8-407d-ba72-1a1797ca9fe1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:42.164064 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 req-dd812c1a-f5d8-407d-ba72-1a1797ca9fe1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.0913451
May 28 14:26:42.211499 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d7667e8d-9d4a-4f07-9a60-e0dc375bad55 req-6c90e2b3-eb87-48f5-a4c1-9e214ea93484 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406847
May 28 14:26:42.951808 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e req-49a2ef7f-b400-4478-862f-172376b41edd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:42.953363 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e req-49a2ef7f-b400-4478-862f-172376b41edd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0831199
May 28 14:26:43.005005 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4e4fb621-62b8-431f-8fdf-b7fe2439aa3e req-9f0bd2fc-c194-4565-aa94-8069db8e23c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0459635
May 28 14:26:43.281145 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228a34ec-7378-4490-8327-b58299088bf6 req-4ec66a97-89b7-41a9-b7be-fd7ba1edca1e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:43.281145 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-228a34ec-7378-4490-8327-b58299088bf6 req-4ec66a97-89b7-41a9-b7be-fd7ba1edca1e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.0884666
May 28 14:26:43.335338 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-228a34ec-7378-4490-8327-b58299088bf6 req-13e95d60-736f-42bc-aaf0-e46c04cdd08a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0499222
May 28 14:26:43.448614 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69928e93-e45d-497c-8529-9a963acced1d req-438ee3c3-ae62-47f7-b571-3630b9e7170a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:43.450107 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-69928e93-e45d-497c-8529-9a963acced1d req-438ee3c3-ae62-47f7-b571-3630b9e7170a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.1101036
May 28 14:26:43.496643 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-69928e93-e45d-497c-8529-9a963acced1d req-152dbf0e-a483-478f-9322-b3e8d3b1f960 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406389
May 28 14:26:43.891144 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35658) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:43.952512 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_v2 [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Deleting subnet 09cda8a0-3e03-4e9f-ab1c-ce37af69f629 {{(pid=92694) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:26:43.955758 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:44.010578 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1655020'] for subnet, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:44.085909 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:44.366557 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 req-0cd369f6-8ee2-4094-81bc-cd02163c4160 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:44.368197 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 req-0cd369f6-8ee2-4094-81bc-cd02163c4160 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.2224503
May 28 14:26:44.537959 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ea8cad18-b6c1-42ed-83fb-7ed5e0c47793 req-cbfcc2ee-3434-4b0e-8fd3-ca9f71493e92 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1595066
May 28 14:26:44.614822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e req-29b0cb7d-f5e4-4048-be8a-46a450c3016b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:44.624439 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e req-29b0cb7d-f5e4-4048-be8a-46a450c3016b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.1325536
May 28 14:26:44.664913 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-80c8ab32-749a-4097-807c-2b7eaaa7ca5e req-465a86d0-3ed0-41fd-8181-79f755bfd3b7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396786
May 28 14:26:44.757197 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee58901c-842d-495e-bc46-5a1d3b074ba7 req-262b9359-ed8e-4438-b5dc-777a6cb1f132 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:44.758823 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ee58901c-842d-495e-bc46-5a1d3b074ba7 req-262b9359-ed8e-4438-b5dc-777a6cb1f132 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.1067095
May 28 14:26:44.831619 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ee58901c-842d-495e-bc46-5a1d3b074ba7 req-a49040db-1608-4b8f-a61a-d4b73d2e28a7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0618408
May 28 14:26:45.170156 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3483512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3521832'] for subnet, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:45.174587 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6a674d0e-289c-4985-864f-3c078feb3ef2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:45.210339 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=09cda8a0-3e03-4e9f-ab1c-ce37af69f629,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:45.218366 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:45.232679 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/09cda8a0-3e03-4e9f-ab1c-ce37af69f629 HTTP/1.1" status: 204  len: 168 time: 1.3396676
May 28 14:26:45.234883 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.235099 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 35674) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:45.235508 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.239250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:26:45.242368 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-06aa8404-8c84-46ab-b03b-707f6d82a433 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:45.344317 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:45.471958 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:45.485518 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba0f2fd90>,) {'filters': {'network_id': ['0d994a91-584d-47dc-9f6d-eb7159fb0da8']}} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:45.497529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0f2fd90>, '89622796-8108-4109-9bba-4e78e65fc59e') {'for_net_delete': True} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:45.497815 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0f2fd90>, '89622796-8108-4109-9bba-4e78e65fc59e') {} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:26:45.508930 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1610771'] for segment, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:45.525336 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:45.533002 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Releasing vlan 855 on physical network physnet1 to pool {{(pid=92695) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:26:45.533625 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1697792'] for segment, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]: Traceback (most recent call last):
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     timer()
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     cb(*args, **kw)
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     return func(*args, **kwargs)
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     self._notify()
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     self.callback(batched_events)
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     event.method(event)
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     return f(self, *a, **k)
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._get(url).json()
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self.request(url, 'GET', **kwargs)
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:26:45.547043 dv-cinder-791281-3-iscsi neutron-server[92695]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:26:45.834987 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 req-c52acceb-b461-434f-b625-5c4b2e79aba4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:45.836590 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 req-c52acceb-b461-434f-b625-5c4b2e79aba4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1100388
May 28 14:26:45.874142 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 req-ae54736b-918b-4259-8fb6-001b44d6eced tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:45.880075 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 req-ae54736b-918b-4259-8fb6-001b44d6eced tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.0994425
May 28 14:26:45.900661 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7c6602ed-4c24-4078-8a1e-5441c5f44b07 req-4f0aa233-bc11-498c-b10a-0fe710390211 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0548699
May 28 14:26:45.903235 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:45.908116 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a583c228-156e-4b77-9134-bc8a67b90dbb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:45.930286 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:45.943271 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Pushing event deleted for resources: {'Network': ['ID=0d994a91-584d-47dc-9f6d-eb7159fb0da8,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:45.947688 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:45.950749 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c81a2868-728f-41eb-85b5-12a2ae7b83a2 req-f6a39528-7d25-44d5-96d7-c0e0c10e6faa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0687017
May 28 14:26:46.041060 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-33876fb1-e7c4-4d60-84f3-bd1fc429cd58 admin admin] 10.222.0.59 "DELETE /v2.0/networks/0d994a91-584d-47dc-9f6d-eb7159fb0da8 HTTP/1.1" status: 204  len: 168 time: 0.8048282
May 28 14:26:46.102095 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffd30142-7cbf-4f1a-89ce-df011cb32112 req-46d17f27-0b9a-44a8-93ed-ed23026eef3d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:46.103647 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ffd30142-7cbf-4f1a-89ce-df011cb32112 req-46d17f27-0b9a-44a8-93ed-ed23026eef3d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.0988913
May 28 14:26:46.151813 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ffd30142-7cbf-4f1a-89ce-df011cb32112 req-7fed0546-7f48-4d68-b57b-516e8579e888 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411439
May 28 14:26:46.474817 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35694) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:46.538113 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-652e22c4-2b6e-48a8-ac8f-1db1a07305e4 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=eba85ed1a1a14a848b3f33435440dff1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0618732
May 28 14:26:46.540539 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 35698) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:26:46.607888 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ea5ec02c-3ac4-4a08-b6ba-99a39baeb823 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:46.633556 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ea5ec02c-3ac4-4a08-b6ba-99a39baeb823 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:46.821014 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ea5ec02c-3ac4-4a08-b6ba-99a39baeb823 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:46.825515 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9e71b420-1a28-4114-be28-611c67f012b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:46.840791 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5ec02c-3ac4-4a08-b6ba-99a39baeb823 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ae740c4-c94e-4bac-9fd6-dc3f96091cac,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:46.843409 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ea5ec02c-3ac4-4a08-b6ba-99a39baeb823 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:46.946040 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ea5ec02c-3ac4-4a08-b6ba-99a39baeb823 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:46.946622 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-ea5ec02c-3ac4-4a08-b6ba-99a39baeb823 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/0ae740c4-c94e-4bac-9fd6-dc3f96091cac HTTP/1.1" status: 204  len: 168 time: 0.4052029
May 28 14:26:47.109275 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06280e3f-d555-4202-9011-5834735f5fd3 req-ec1ebf73-2252-49f0-b4fd-c47fac815367 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:47.110787 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-06280e3f-d555-4202-9011-5834735f5fd3 req-ec1ebf73-2252-49f0-b4fd-c47fac815367 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0915473
May 28 14:26:47.157080 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-06280e3f-d555-4202-9011-5834735f5fd3 req-b1083275-64c1-475a-81f9-19689bf70d45 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406621
May 28 14:26:47.344110 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0068499d-b9b5-410d-bd5a-9129f5a94604 req-e19027c9-7986-40de-89a9-46156d53f503 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:47.345791 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0068499d-b9b5-410d-bd5a-9129f5a94604 req-e19027c9-7986-40de-89a9-46156d53f503 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.0825179
May 28 14:26:47.393791 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0068499d-b9b5-410d-bd5a-9129f5a94604 req-60b36134-8ea6-49f0-9a96-eb430c3112b4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422041
May 28 14:26:47.583713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e06b805-69a4-4bb3-b802-8304c0d3dcff req-2c18d240-2800-4413-ab72-dcac2c99c88c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:47.585207 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0e06b805-69a4-4bb3-b802-8304c0d3dcff req-2c18d240-2800-4413-ab72-dcac2c99c88c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.0916302
May 28 14:26:47.633951 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0e06b805-69a4-4bb3-b802-8304c0d3dcff req-873b7ff9-dd34-4fe7-a94e-d120125b1135 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424588
May 28 14:26:48.380573 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0527c8a-6a48-4e23-a617-f34b4bed9690 req-72317454-1252-41a4-bfce-f032b7d2e85c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:48.382707 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c0527c8a-6a48-4e23-a617-f34b4bed9690 req-72317454-1252-41a4-bfce-f032b7d2e85c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0976536
May 28 14:26:48.436574 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c0527c8a-6a48-4e23-a617-f34b4bed9690 req-79975c89-cc98-40f9-8f68-c369f8b56319 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0475101
May 28 14:26:48.646654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb4262-3775-4761-9318-395cdfe0ae56 req-6f063fce-04e7-488a-96f6-188fcf22b0b6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:48.651417 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fffb4262-3775-4761-9318-395cdfe0ae56 req-6f063fce-04e7-488a-96f6-188fcf22b0b6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.0957007
May 28 14:26:48.696442 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fffb4262-3775-4761-9318-395cdfe0ae56 req-4ef73421-d7c5-4f3a-8fbd-41b3db0c5fda tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420778
May 28 14:26:48.893295 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ea52dc-3873-4749-a88d-27262d3f0a41 req-0366d0b4-2161-4fe6-a4af-7e92c1a3ab69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:48.900269 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-69ea52dc-3873-4749-a88d-27262d3f0a41 req-0366d0b4-2161-4fe6-a4af-7e92c1a3ab69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.1032786
May 28 14:26:48.954254 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-69ea52dc-3873-4749-a88d-27262d3f0a41 req-1e1732f4-c759-4c22-88bb-861314306057 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0530555
May 28 14:26:49.406102 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-a9023829-85fe-4651-9b6f-970d1e7a17b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:security_group {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:26:49.500749 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-a9023829-85fe-4651-9b6f-970d1e7a17b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:security_group {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:26:49.502011 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-a9023829-85fe-4651-9b6f-970d1e7a17b3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2127224596&fields=id&tenant_id=c6d2d25991f04f00a48394ddbeec688e HTTP/1.1" status: 200  len: 267 time: 0.1576293
May 28 14:26:49.675760 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-8906d5b2-7739-4787-8837-2419b51b1373 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:49.677072 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-8906d5b2-7739-4787-8837-2419b51b1373 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 812 time: 0.1672101
May 28 14:26:49.695005 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-d648983d-3ec0-48bc-85fe-7ef5b7bf94e5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/quotas/c6d2d25991f04f00a48394ddbeec688e HTTP/1.1" status: 200  len: 375 time: 0.0099292
May 28 14:26:49.796490 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-a41d5ea4-449b-425f-a34e-b9fe683e4380 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0953033
May 28 14:26:49.969555 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-f1a30e99-15ee-47eb-a178-41b7aa4d3cbb service neutron] 10.222.0.59 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1602497
May 28 14:26:50.123517 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-b4b5e6a0-ed5c-4c19-a915-8ae09b0fc637 service neutron] 10.222.0.59 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1529768
May 28 14:26:51.192720 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f032dde7-4d76-42ad-a295-83a3e1aa3978 req-8e914172-1c3a-43a2-bdf4-769fb81938c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:51.194196 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f032dde7-4d76-42ad-a295-83a3e1aa3978 req-8e914172-1c3a-43a2-bdf4-769fb81938c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0904701
May 28 14:26:51.253705 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f032dde7-4d76-42ad-a295-83a3e1aa3978 req-ec11ab99-aef1-4bdd-93c8-34e39e2d45b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0521362
May 28 14:26:51.440042 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 req-856fb477-d06b-4f3a-8425-228b5669e119 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:51.441491 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 req-856fb477-d06b-4f3a-8425-228b5669e119 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.0810456
May 28 14:26:51.492956 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-01fc6b2b-1de9-4ae5-896d-425c84f906b8 req-35eecbf8-8470-4d84-a9f0-a129f9a1b92d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444331
May 28 14:26:51.688230 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 req-485266a6-a280-49e2-8726-5e6c5a9a2f21 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:51.692099 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 req-485266a6-a280-49e2-8726-5e6c5a9a2f21 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.0902407
May 28 14:26:51.739735 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1e3861b4-7cd7-4e01-b1ef-c83441a66081 req-c0930039-37bc-4a80-94d2-77a995e98e25 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432827
May 28 14:26:51.822615 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6f03976a-af7a-41a8-a35c-db7e50d4e6a3 req-35b0e204-2524-4783-9f75-c6aacd41dc01 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 210 time: 0.0422828
May 28 14:26:52.519708 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f1d21e6-4c12-40d8-8920-0164eb031d49 req-8a042e09-9ac4-4cdf-8a53-70ce1bc2d093 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:52.520672 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1f1d21e6-4c12-40d8-8920-0164eb031d49 req-8a042e09-9ac4-4cdf-8a53-70ce1bc2d093 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1565850
May 28 14:26:52.566912 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1f1d21e6-4c12-40d8-8920-0164eb031d49 req-42c21e51-b08e-442f-865a-7a28f394363e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393801
May 28 14:26:52.753394 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da63001-4fe9-48fa-9881-5e46391d0978 req-72823c70-f8fc-4570-90cb-985d95cf944b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:52.754843 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da63001-4fe9-48fa-9881-5e46391d0978 req-72823c70-f8fc-4570-90cb-985d95cf944b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.0883505
May 28 14:26:52.799221 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4da63001-4fe9-48fa-9881-5e46391d0978 req-380a9c9e-69ea-44a0-976b-c833b0d4ce33 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387096
May 28 14:26:52.980307 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f939ff48-2967-4c1e-9a08-1865c80808fe req-db45b646-8f63-4720-8996-28acc03c57c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:52.981880 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f939ff48-2967-4c1e-9a08-1865c80808fe req-db45b646-8f63-4720-8996-28acc03c57c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.0835092
May 28 14:26:53.028540 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f939ff48-2967-4c1e-9a08-1865c80808fe req-a9079fb3-77cd-48f6-a2f2-0884f6ded9cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409169
May 28 14:26:53.166873 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fea62e3b-8b1f-488b-82c8-22787b4a374d req-910c6913-b8ee-438a-9efa-29d237bd133d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 210 time: 0.0479505
May 28 14:26:53.541221 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:26:53.760308 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206227b2-922d-4c7f-aa3c-e1b138a324a8 req-bb04ae57-0f44-4d49-ac0a-dfc8301fd2b6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:53.762250 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-206227b2-922d-4c7f-aa3c-e1b138a324a8 req-bb04ae57-0f44-4d49-ac0a-dfc8301fd2b6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0831819
May 28 14:26:53.807567 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-206227b2-922d-4c7f-aa3c-e1b138a324a8 req-ae98a9c7-724e-44a4-90d7-d0bd3386114c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394971
May 28 14:26:53.988253 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 req-b1434536-5c73-4b99-bf3d-41d6cbfac894 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:53.989678 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 req-b1434536-5c73-4b99-bf3d-41d6cbfac894 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.0825672
May 28 14:26:54.035016 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b4b98a59-612b-4ea1-9d4e-d3ef89a3c563 req-6d8b98b3-3ea5-4aba-b8c2-c0a903fc0573 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394609
May 28 14:26:54.213766 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 req-cc8ce67b-f732-47b1-a4f7-32ce3a3fe368 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:54.216263 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 req-cc8ce67b-f732-47b1-a4f7-32ce3a3fe368 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.0846438
May 28 14:26:54.263793 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8080fb18-0948-4c1b-a62a-12c2d98bb5e1 req-f8a2a840-a454-4709-a9b3-ffce40a77f3d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415621
May 28 14:26:54.403513 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f1f4f108-7e4f-499a-a456-4ed512be0d0a req-f95f4428-deac-4dd8-a43d-98fc3a60695b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 210 time: 0.0462632
May 28 14:26:54.884786 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Request body: {'port': {'device_id': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:55.122026 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:55.147849 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-22c0fdb0-63b0-4ebc-a377-aca525d22df9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:55.151128 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-22c0fdb0-63b0-4ebc-a377-aca525d22df9 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 1096 time: 0.2329006
May 28 14:26:55.185868 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 req-609ea199-3d14-40f6-a279-4c991c20e62a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:55.187301 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 req-609ea199-3d14-40f6-a279-4c991c20e62a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.2314837
May 28 14:26:55.402098 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-791e40f8-2fe2-4842-91bc-3f305a3b06e1 req-0fdd908b-6430-4263-91f2-182dbdd0d2ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1808205
May 28 14:26:55.468423 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-a1877d2f-2748-4dcb-a100-4f0c5f5d4f73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:55.470961 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-a1877d2f-2748-4dcb-a100-4f0c5f5d4f73 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&shared=False HTTP/1.1" status: 200  len: 915 time: 0.2927494
May 28 14:26:55.765177 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-f002bf48-ed80-47f4-b08a-07e8a388644f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:55.766746 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d4d56db-3230-48b3-a583-1ef391f5f4ce req-f002bf48-ed80-47f4-b08a-07e8a388644f service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2498319
May 28 14:26:55.782528 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7387df35-13fa-453f-b7ea-eee60b388c94 req-7dc7760f-1283-4e0a-b2d7-9c990b1254d6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:55.784005 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7387df35-13fa-453f-b7ea-eee60b388c94 req-7dc7760f-1283-4e0a-b2d7-9c990b1254d6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 932 time: 0.2682240
May 28 14:26:55.998577 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e req-71e8f14a-e2cd-4e33-be1b-92be3cf17aa4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:56.000387 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e req-71e8f14a-e2cd-4e33-be1b-92be3cf17aa4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.0886781
May 28 14:26:56.011175 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 164fd7c8-7a57-4285-93ef-c3fdabceb8be {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:26:56.022167 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:56.050337 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7387df35-13fa-453f-b7ea-eee60b388c94 req-6fa8026d-40a9-4483-a764-6ca7e195ecba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2317564
May 28 14:26:56.057463 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Transition to ACTIVE for port object 164fd7c8-7a57-4285-93ef-c3fdabceb8be will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:56.060806 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-71b27e6f-88b7-48ae-b733-a28ca7be0c4e req-a92045a0-e262-4ef3-9398-8b4d9cff955b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0535238
May 28 14:26:56.081975 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-4f7b7ca6-c37d-4121-9b0c-6ba637e44af0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:56.089798 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-4f7b7ca6-c37d-4121-9b0c-6ba637e44af0 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 1096 time: 0.1332736
May 28 14:26:56.173529 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-b39b0bf6-b66d-47a0-b016-62698f276194 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=965a8c13-7f18-4e6d-92f2-16c7c866bcfd HTTP/1.1" status: 200  len: 217 time: 0.0654790
May 28 14:26:56.173529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:56.174524 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-21971bcf-4084-4dba-899c-d0278bd11021 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:56.370134 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7db5cbc5-2fad-4916-885b-47b179453b29 req-2b1e5274-3719-44e3-8dc4-719f92bbbc6f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 210 time: 0.1602006
May 28 14:26:56.436641 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Pushing event updated for resources: {'Port': ['ID=164fd7c8-7a57-4285-93ef-c3fdabceb8be,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:56.445622 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:56.478248 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-c16214e4-4f3b-42ed-a9c0-f1af2bd9d778 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:56.482930 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-c16214e4-4f3b-42ed-a9c0-f1af2bd9d778 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e HTTP/1.1" status: 200  len: 854 time: 0.2755957
May 28 14:26:56.542243 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-df5f2619-eff1-409c-ac20-6473efaef31e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=37e18bf5-545d-49a2-afdf-585587a7907f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0493009
May 28 14:26:56.609818 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4485f46b-7f37-4cb9-b366-8a3adf601f2b req-398e39db-3a92-4d53-b637-9aca8e916860 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:56.611240 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4485f46b-7f37-4cb9-b366-8a3adf601f2b req-398e39db-3a92-4d53-b637-9aca8e916860 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0852094
May 28 14:26:56.630973 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Attempting to bind port 164fd7c8-7a57-4285-93ef-c3fdabceb8be on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:26:56.631317 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Attempting to bind port 164fd7c8-7a57-4285-93ef-c3fdabceb8be by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:26:56.631679 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Attempting to bind port 164fd7c8-7a57-4285-93ef-c3fdabceb8be on network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:26:56.649931 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Port 164fd7c8-7a57-4285-93ef-c3fdabceb8be on network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:26:56.650261 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Attempting to bind port 164fd7c8-7a57-4285-93ef-c3fdabceb8be on network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:26:56.660997 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 26, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:26:56.661349 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Checking segment: {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:26:56.665008 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Bound using segment: {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:26:56.665008 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Bound port: 164fd7c8-7a57-4285-93ef-c3fdabceb8be, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5d4a0d84-b33a-4965-b76a-6b4579480439', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:26:56.665230 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4485f46b-7f37-4cb9-b366-8a3adf601f2b req-03bccd85-42fc-4b63-bc4c-83c18ea7bcb5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0446203
May 28 14:26:56.665331 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:56.763066 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-f6a292b4-61d9-4e32-a50f-e2f528442da1 service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2093630
May 28 14:26:56.857928 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] For port 164fd7c8-7a57-4285-93ef-c3fdabceb8be, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:26:56.879096 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] For port 164fd7c8-7a57-4285-93ef-c3fdabceb8be, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:26:56.921042 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-174b3b85-c280-4dce-82a7-73c2d13d3b30 req-ffc5be4b-c393-4929-a3b6-9d5797198107 service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1419744
May 28 14:26:57.003198 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:57.010948 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:57.131898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:57.132603 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:57.133859 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] 10.222.0.90 "PUT /v2.0/ports/164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 1094 time: 2.2536731
May 28 14:26:57.136230 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:26:57.252877 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-4f5d3ef8-b910-4f35-a4a4-706e63827f71 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:57.258926 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-4f5d3ef8-b910-4f35-a4a4-706e63827f71 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 812 time: 0.2791080
May 28 14:26:57.309490 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dacca39b-e712-4ad3-92e3-c711836e7fe6 req-23d126f7-d949-4afb-bc4b-13e0a1e9a3ba tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:57.311283 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dacca39b-e712-4ad3-92e3-c711836e7fe6 req-23d126f7-d949-4afb-bc4b-13e0a1e9a3ba tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.1012287
May 28 14:26:57.352087 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:26:57.365917 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Pushing event updated for resources: {'Port': ['ID=164fd7c8-7a57-4285-93ef-c3fdabceb8be,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:57.369718 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dacca39b-e712-4ad3-92e3-c711836e7fe6 req-0dc5b2b8-8fae-4ae9-818e-71e53ba65ae2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524189
May 28 14:26:57.393006 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.374s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:57.461638 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'status': 'completed', 'code': 200}
May 28 14:26:57.467135 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-29e526ee-1e2b-4660-80ec-66c149a3fce0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c6d2d25991f04f00a48394ddbeec688e HTTP/1.1" status: 200  len: 380 time: 0.1139605
May 28 14:26:57.481938 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'port': {'device_id': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'admin_state_up': True, 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'security_groups': ['fe9fa133-b1e0-4e56-971e-af9cdb27b031']}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:57.546210 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:57.559950 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-6ddcbb99-8645-47ca-b6a2-40f8e2837877 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:57.561154 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'port_id': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'mac_address': 'fa:16:3e:f8:88:b6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 869, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:26:57.561461 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-6ddcbb99-8645-47ca-b6a2-40f8e2837877 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=cf7193774c754e07a6f683666ab4addf&device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1097 time: 0.2417953
May 28 14:26:57.569369 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48586e30-2149-439b-b3b8-9f73d0c05848 req-139df1ea-28a1-41d7-ae7d-d8dd8aea9b64 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:57.570823 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-48586e30-2149-439b-b3b8-9f73d0c05848 req-139df1ea-28a1-41d7-ae7d-d8dd8aea9b64 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 944 time: 0.3044705
May 28 14:26:57.614578 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 req-e9332c86-9c69-454c-808c-c78536b04011 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:26:57.617782 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:57.637418 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id c2872b93-4077-4bc0-8619-140f73de2a3a {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:26:57.655164 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:57.741401 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 req-e9332c86-9c69-454c-808c-c78536b04011 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:26:57.742614 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-54a37d57-78cb-4c3c-9ee3-7ed9b250b303 req-e9332c86-9c69-454c-808c-c78536b04011 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 210 time: 0.1814618
May 28 14:26:57.765878 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-52a58aec-9cd0-44b0-b1b0-a782771c6447 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 217 time: 0.1750815
May 28 14:26:57.781206 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:57.790339 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-d6d9dfee-1f81-433a-a128-99b07a1705c3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:57.853271 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-48586e30-2149-439b-b3b8-9f73d0c05848 req-fe00934e-079d-410a-aed6-cafe4108dddb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1393330
May 28 14:26:57.864308 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=6']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:57.878015 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:57.878128 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-0603f5c7-db84-4476-a902-e3aab7990ef2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:57.878128 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-0603f5c7-db84-4476-a902-e3aab7990ef2 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=31bcc630-98a7-46cc-9928-64d7da56d404 HTTP/1.1" status: 200  len: 853 time: 0.1162436
May 28 14:26:57.895358 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:57.915428 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:26:57.937293 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:26:57.946142 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b req-2ca390a5-4825-49eb-80b9-46ea7e862a47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:57.951010 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b req-2ca390a5-4825-49eb-80b9-46ea7e862a47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.0909295
May 28 14:26:57.973900 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-128bdf9b-488d-4536-8f0a-78a119ca5503 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:57.975371 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-128bdf9b-488d-4536-8f0a-78a119ca5503 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=780506d2-6c05-4b1f-af1f-a4a3d627ec86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0907636
May 28 14:26:57.996162 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d7c7d0ad-2b68-410f-8497-a9bb96a20e6b req-bb515868-cc75-415a-8354-ed2a363d4532 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416067
May 28 14:26:58.036857 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['c2872b93-4077-4bc0-8619-140f73de2a3a'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:26:58.085760 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Made reservation on behalf of c6d2d25991f04f00a48394ddbeec688e for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:26:58.094209 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:58.186273 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-8e4f3bea-6ea5-4757-a581-3d2427e467b7 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1880548
May 28 14:26:58.396379 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e4fbcd1a-05be-4210-b66f-8ae6a5b82c8c req-1681960f-b300-4a34-b4d8-8be2f3383e89 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2142944
May 28 14:26:58.400124 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Allocated IP 172.20.0.9 (89b0ce92-0695-466c-b1ce-9a354ecba633/a63662e1-f44d-44cd-98c9-2b87dba66278/4b79b510-d52c-4720-bf56-28c541fff0b4) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:26:58.713097 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:58.736846 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-8b02dc63-8f65-4848-8c65-a9f260491942 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:58.738306 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-8b02dc63-8f65-4848-8c65-a9f260491942 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=cf7193774c754e07a6f683666ab4addf&device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1097 time: 0.2225592
May 28 14:26:58.739242 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Transition to ACTIVE for port object 4b79b510-d52c-4720-bf56-28c541fff0b4 will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:26:58.748931 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de21b0d0-c9f4-4b76-96c6-c845d210be87 req-51e6d3b3-8261-4d79-967b-d3fa779ad4e3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:58.750302 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-de21b0d0-c9f4-4b76-96c6-c845d210be87 req-51e6d3b3-8261-4d79-967b-d3fa779ad4e3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.2334020
May 28 14:26:58.896893 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c64526f6-c308-48f2-a1ee-8e8fee089534 req-17538021-eebd-40b4-b09b-0143233c02e1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 210 time: 0.0436301
May 28 14:26:58.908093 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-de21b0d0-c9f4-4b76-96c6-c845d210be87 req-5a5c2d99-3685-42b4-9f7c-0570a51dc19b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1330566
May 28 14:26:58.938159 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-e9ea1c3c-da81-4c1e-901d-bb3d06395593 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:58.939682 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-e9ea1c3c-da81-4c1e-901d-bb3d06395593 service neutron] 10.222.0.90 "GET /v2.0/networks?id=780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 200  len: 915 time: 0.1874657
May 28 14:26:59.014555 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:59.026126 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fb412511-4415-4648-8d13-87e4fed365e9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:59.063684 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-5aea23de-2410-4d8f-90f8-c7f64c98222e service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 217 time: 0.1080422
May 28 14:26:59.085644 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 req-1957c940-b37a-4d09-8ffc-0efa6c52b2bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:59.087342 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 req-1957c940-b37a-4d09-8ffc-0efa6c52b2bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 944 time: 0.0907919
May 28 14:26:59.144638 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e65915ab-69d4-46b9-8fdc-36be3cf9fe06 req-80a0ce00-048d-400e-a1f7-2043c3bf493d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0500782
May 28 14:26:59.170915 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:26:59.188578 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:26:59.196750 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:26:59.227341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'Port': ['ID=4b79b510-d52c-4720-bf56-28c541fff0b4,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:59.235934 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:26:59.275912 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-295d3693-2d2e-4f89-affa-5c554e27105d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:59.277396 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-295d3693-2d2e-4f89-affa-5c554e27105d service neutron] 10.222.0.90 "GET /v2.0/subnets?id=31bcc630-98a7-46cc-9928-64d7da56d404 HTTP/1.1" status: 200  len: 853 time: 0.2045784
May 28 14:26:59.392631 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:26:59.444536 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:59.445154 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:59.500214 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 req-edd3c422-8423-47b9-a0a0-2d10eaf61a1c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:59.500214 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 req-edd3c422-8423-47b9-a0a0-2d10eaf61a1c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.3755581
May 28 14:26:59.509093 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port c2872b93-4077-4bc0-8619-140f73de2a3a triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:59.509473 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:59.531689 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-bd1ba586-a222-4ab1-91b5-ae008e7393e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:26:59.533104 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-bd1ba586-a222-4ab1-91b5-ae008e7393e1 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=780506d2-6c05-4b1f-af1f-a4a3d627ec86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2453573
May 28 14:26:59.575199 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.0980182
May 28 14:26:59.607372 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-687e46da-39e4-410b-ba89-6a2d6240a49a None None] Provisioning for port 4b79b510-d52c-4720-bf56-28c541fff0b4 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:26:59.623675 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0cc7f0a3-cd71-4d48-a712-b4b215f40ab9 req-b9eaa24a-6ae6-4a3f-a9d8-1a37664b66f4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1170912
May 28 14:26:59.626175 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-687e46da-39e4-410b-ba89-6a2d6240a49a None None] Provisioning complete for port 4b79b510-d52c-4720-bf56-28c541fff0b4 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:26:59.626935 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-687e46da-39e4-410b-ba89-6a2d6240a49a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:59.632618 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Request body: {'port': {'device_id': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:26:59.679759 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:59.705475 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-687e46da-39e4-410b-ba89-6a2d6240a49a None None] Port 4b79b510-d52c-4720-bf56-28c541fff0b4 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:26:59.713453 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:26:59.724034 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:26:59.784594 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-836f430e-d48e-44dd-8699-907c324804c4 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2408504
May 28 14:26:59.789133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:59.826922 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:26:59.828972 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:26:59.905588 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'code': 200}
May 28 14:26:59.908047 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=7']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:26:59.913367 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:00.021232 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-20c594e2-071c-440f-98f5-cdd5b7579238 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:00.094579 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-990d27e3-6700-4394-b6f9-ec37677cfcd3 req-c20ce300-237f-4a1b-8aee-fc6e0db8f41d service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2953327
May 28 14:27:00.112901 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47bf58fa-247f-4534-a3bd-be0fdf80c643 req-260150c5-0c2d-4dcc-94cf-db54e8d81bf8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:00.116251 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-47bf58fa-247f-4534-a3bd-be0fdf80c643 req-260150c5-0c2d-4dcc-94cf-db54e8d81bf8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.0924139
May 28 14:27:00.163170 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-47bf58fa-247f-4534-a3bd-be0fdf80c643 req-2e1fd3f4-525d-4f36-80da-43ae3ed55a32 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415163
May 28 14:27:00.237724 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-417733ea-c3b8-4890-95fd-d0d96502d9fa req-c21ba6a0-2335-4c16-8049-b64ae4467dde tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:00.238421 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-417733ea-c3b8-4890-95fd-d0d96502d9fa req-c21ba6a0-2335-4c16-8049-b64ae4467dde tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:27:00.347017 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-417733ea-c3b8-4890-95fd-d0d96502d9fa req-c21ba6a0-2335-4c16-8049-b64ae4467dde tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:27:00.348174 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-417733ea-c3b8-4890-95fd-d0d96502d9fa req-c21ba6a0-2335-4c16-8049-b64ae4467dde tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 931 time: 0.3367691
May 28 14:27:00.357356 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4b79b510-d52c-4720-bf56-28c541fff0b4 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:27:00.359433 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb req-f479a374-df40-4b0e-a23d-cd1c8f40d4b5 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:00.366866 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb req-f479a374-df40-4b0e-a23d-cd1c8f40d4b5 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 944 time: 0.1085811
May 28 14:27:00.378342 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:00.409281 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fdc63ebc-e017-4bea-bbda-dd4f7aca78fb req-72e1d42c-7762-414b-93ae-dc658017b280 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415154
May 28 14:27:00.411160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Transition to ACTIVE for port object 4b79b510-d52c-4720-bf56-28c541fff0b4 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:27:00.418515 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-417733ea-c3b8-4890-95fd-d0d96502d9fa req-a2d5684a-6718-402d-8dd1-fb26a773d0e4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0570753
May 28 14:27:00.478022 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:00.481992 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e3b59ea9-bd12-4b54-b3de-14d3e7893a8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:00.644613 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Pushing event updated for resources: {'Port': ['ID=4b79b510-d52c-4720-bf56-28c541fff0b4,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:00.647508 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:00.732645 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Attempting to bind port 4b79b510-d52c-4720-bf56-28c541fff0b4 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:27:00.733011 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Attempting to bind port 4b79b510-d52c-4720-bf56-28c541fff0b4 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:27:00.733442 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Attempting to bind port 4b79b510-d52c-4720-bf56-28c541fff0b4 on network 89b0ce92-0695-466c-b1ce-9a354ecba633 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:27:00.738339 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Port 4b79b510-d52c-4720-bf56-28c541fff0b4 on network 89b0ce92-0695-466c-b1ce-9a354ecba633 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:27:00.738662 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Attempting to bind port 4b79b510-d52c-4720-bf56-28c541fff0b4 on network 89b0ce92-0695-466c-b1ce-9a354ecba633 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:27:00.744171 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 26, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:27:00.744506 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Checking segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:27:00.744889 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Bound using segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:27:00.745845 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Bound port: 4b79b510-d52c-4720-bf56-28c541fff0b4, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:27:00.746210 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:00.835266 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7555d83-3569-4181-bea0-fe9a030f41ff req-7dc1460d-f494-4537-ae07-29edbc1c979b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:00.837180 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f7555d83-3569-4181-bea0-fe9a030f41ff req-7dc1460d-f494-4537-ae07-29edbc1c979b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0867093
May 28 14:27:00.844014 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] For port 4b79b510-d52c-4720-bf56-28c541fff0b4, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:27:00.848257 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] For port 4b79b510-d52c-4720-bf56-28c541fff0b4, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=4b79b510-d52c-4720-bf56-28c541fff0b4,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:27:00.883452 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f7555d83-3569-4181-bea0-fe9a030f41ff req-dc1ec5a8-e362-45dc-a327-79a0823b4ad5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405605
May 28 14:27:00.928101 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:00.932429 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-29c574ba-910a-4468-80f1-c98bcad540d2 tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:00.994072 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:00.994571 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:00.996583 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-c4930000-e325-4893-a690-e15b1baca16b service neutron] 10.222.0.90 "PUT /v2.0/ports/4b79b510-d52c-4720-bf56-28c541fff0b4 HTTP/1.1" status: 200  len: 1093 time: 1.3718154
May 28 14:27:00.999715 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'tag': '4b79b510-d52c-4720-bf56-28c541fff0b4'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:27:01.026453 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Pushing event updated for resources: {'Port': ['ID=4b79b510-d52c-4720-bf56-28c541fff0b4,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:01.030502 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:01.052203 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'tag': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'status': 'completed', 'code': 200}
May 28 14:27:01.156684 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-2c12ef3a-66ef-41b2-9b5b-b22081cdf366 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:01.158297 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-2c12ef3a-66ef-41b2-9b5b-b22081cdf366 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 1096 time: 0.0768163
May 28 14:27:01.310982 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-60851cf5-8ae1-4dd6-90b2-d509e6d8f12c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:01.312463 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-60851cf5-8ae1-4dd6-90b2-d509e6d8f12c service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=c6d2d25991f04f00a48394ddbeec688e&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1457407
May 28 14:27:01.360639 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c0828f-3f11-4f21-8db6-da038548a1bc req-b3b88c85-863f-4481-ae69-fd5c7820ca3b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:01.362147 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c3c0828f-3f11-4f21-8db6-da038548a1bc req-b3b88c85-863f-4481-ae69-fd5c7820ca3b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 943 time: 0.0855830
May 28 14:27:01.411395 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 965a8c13-7f18-4e6d-92f2-16c7c866bcfd details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:27:01.412011 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c3c0828f-3f11-4f21-8db6-da038548a1bc req-09a905c3-845d-45ac-b77b-8f5d5212d20d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438728
May 28 14:27:01.555310 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-cea01da0-6304-4aa8-8e6c-a2f383cf7810 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:01.557018 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9782d2e5-5784-444b-a209-b5852db5a4b1 req-cea01da0-6304-4aa8-8e6c-a2f383cf7810 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2377470
May 28 14:27:01.638892 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:01.640965 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9742d2c5-da69-495d-a3f9-dd86428b869e req-67fca806-2a1d-4e7f-8c49-faafbde93064 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:01.643029 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9742d2c5-da69-495d-a3f9-dd86428b869e req-67fca806-2a1d-4e7f-8c49-faafbde93064 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.1101704
May 28 14:27:01.655640 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f', 'port_id': '965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'mac_address': 'fa:16:3e:0f:d0:d0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 851, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:27:01.699111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-9742d2c5-da69-495d-a3f9-dd86428b869e req-bdc85d59-1c0d-4ca2-bf99-259c3e4be2ad tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:27:01.713262 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-a5ecc296-a5ae-4e23-908b-68fd6abb8c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:01.713756 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-9742d2c5-da69-495d-a3f9-dd86428b869e req-bdc85d59-1c0d-4ca2-bf99-259c3e4be2ad tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:27:01.715394 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-a5ecc296-a5ae-4e23-908b-68fd6abb8c45 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 1096 time: 0.1040149
May 28 14:27:01.715521 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9742d2c5-da69-495d-a3f9-dd86428b869e req-bdc85d59-1c0d-4ca2-bf99-259c3e4be2ad tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0661311
May 28 14:27:01.719870 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:01.724295 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a18e26-f686-4f73-8a23-4b5cb57093f7 req-40ef5058-8b7e-4ccc-a798-ffde4bda0e2a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:01.725865 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-84a18e26-f686-4f73-8a23-4b5cb57093f7 req-40ef5058-8b7e-4ccc-a798-ffde4bda0e2a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 944 time: 0.1677909
May 28 14:27:01.741090 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 965a8c13-7f18-4e6d-92f2-16c7c866bcfd {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:27:01.758433 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:01.816790 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-1995409b-8267-4c50-82e5-665982dcb19c service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4b79b510-d52c-4720-bf56-28c541fff0b4 HTTP/1.1" status: 200  len: 217 time: 0.0852354
May 28 14:27:01.855114 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:01.857180 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-8c1c74ec-3e62-4e4e-95b2-810b4a4cef05 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:01.886928 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-84a18e26-f686-4f73-8a23-4b5cb57093f7 req-5b16cd78-6a8e-4bc8-a4b8-0137432a511a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1014626
May 28 14:27:01.901560 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-e6db2125-a548-4056-8980-b9561578f519 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:01.903509 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-e6db2125-a548-4056-8980-b9561578f519 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.0757780
May 28 14:27:01.934907 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:01.938666 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:01.981377 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-70b8a539-b3e8-4e87-8167-166d4d769988 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:01.983006 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-70b8a539-b3e8-4e87-8167-166d4d769988 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0722442
May 28 14:27:02.082501 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6085c5b-d280-410b-b95f-ee6cb56cf144 req-e4a57ea0-25c6-40e3-bf61-3ff5e8092155 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:02.084003 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d6085c5b-d280-410b-b95f-ee6cb56cf144 req-e4a57ea0-25c6-40e3-bf61-3ff5e8092155 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0829525
May 28 14:27:02.131109 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-8ff1213a-d2e3-4204-9687-4d77d22d5bc8 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1371994
May 28 14:27:02.133278 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d6085c5b-d280-410b-b95f-ee6cb56cf144 req-2e080a1b-a0f0-4f91-9c1a-8d9bf9d1e334 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0427051
May 28 14:27:02.294097 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99c93ba1-6be2-4ffe-808c-f475cf4dcb74 req-1c48dc8b-7229-407a-8c67-88a8d3d1fe7d service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1537316
May 28 14:27:02.476160 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:02.495123 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d1249c22-ee8a-4a1f-a25d-5886749677e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:02.606629 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30642616-bbcc-4b97-a397-36ea6e615812 req-b9847997-9d33-49d7-be42-a305fbbc2960 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:02.608082 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-30642616-bbcc-4b97-a397-36ea6e615812 req-b9847997-9d33-49d7-be42-a305fbbc2960 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 944 time: 0.0856326
May 28 14:27:02.657496 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-30642616-bbcc-4b97-a397-36ea6e615812 req-46b9a5e4-178f-4f7c-b71f-34939a067e94 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436020
May 28 14:27:02.910172 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 req-244d3e49-61a9-4c4c-b933-e4a7c2b38a45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:02.911691 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 req-244d3e49-61a9-4c4c-b933-e4a7c2b38a45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0858264
May 28 14:27:02.960004 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d61019bc-b8d0-4ec8-ba1f-38b5f2f5f815 req-8de78f94-746a-4baa-a218-314b810db59c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0424292
May 28 14:27:03.074053 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c5e38f-d8c2-4454-b673-be3b816d02bb req-2dfc7db5-74c7-4b26-adbc-40d576fe3b33 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:03.075513 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d1c5e38f-d8c2-4454-b673-be3b816d02bb req-2dfc7db5-74c7-4b26-adbc-40d576fe3b33 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 944 time: 0.0807443
May 28 14:27:03.123348 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d1c5e38f-d8c2-4454-b673-be3b816d02bb req-594d4488-5964-41d2-82d7-5336005b7193 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421226
May 28 14:27:03.326698 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca61cac9-87d6-490c-81c5-f0ad896f23db req-7b32e3f9-17db-4d2e-b0f3-4ea3629e88a9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:03.328123 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ca61cac9-87d6-490c-81c5-f0ad896f23db req-7b32e3f9-17db-4d2e-b0f3-4ea3629e88a9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0804367
May 28 14:27:03.373349 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ca61cac9-87d6-490c-81c5-f0ad896f23db req-fa951e9b-494e-4d31-8ba6-7ec977aee41f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396645
May 28 14:27:03.422618 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 164fd7c8-7a57-4285-93ef-c3fdabceb8be details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:27:03.554083 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 164fd7c8-7a57-4285-93ef-c3fdabceb8be, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:03.567461 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'port_id': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'mac_address': 'fa:16:3e:27:02:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 857, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:27:03.632997 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:03.658755 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 164fd7c8-7a57-4285-93ef-c3fdabceb8be {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:27:03.675334 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 164fd7c8-7a57-4285-93ef-c3fdabceb8be, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:03.700818 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:03.769175 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:03.771129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:03.812567 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['965a8c13-7f18-4e6d-92f2-16c7c866bcfd'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:27:03.862036 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 req-27ed3b23-f559-4ea2-ad74-f042eff0ce69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:03.863624 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 req-27ed3b23-f559-4ea2-ad74-f042eff0ce69 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 944 time: 0.1013074
May 28 14:27:03.908889 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=164fd7c8-7a57-4285-93ef-c3fdabceb8be,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:03.909479 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6b6cd5bc-f71d-4e50-b4e4-92ce68370e63 req-1932830c-627a-4e10-bc1a-1a2e9d7977af tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396299
May 28 14:27:03.927811 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.928153 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.928487 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.928812 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.929134 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.929454 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.929771 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.930086 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.930403 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.930719 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.931028 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.931340 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:03.936990 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:04.229017 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b7514f-115b-4412-9a6d-7860471d60cd req-3c802fb7-ba98-47c9-9148-b17e3fc40e42 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:04.230522 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-31b7514f-115b-4412-9a6d-7860471d60cd req-3c802fb7-ba98-47c9-9148-b17e3fc40e42 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.1599784
May 28 14:27:04.275247 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-31b7514f-115b-4412-9a6d-7860471d60cd req-d8df37b9-2cb3-4e92-809e-61a97c64ae91 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389211
May 28 14:27:04.310892 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 req-24698fca-bd67-4cf5-8153-f983639e24b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:04.312363 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 req-24698fca-bd67-4cf5-8153-f983639e24b8 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 945 time: 0.0810251
May 28 14:27:04.356209 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-33f5acb5-73fb-4db8-b694-58a1b9f350f4 req-c5d71929-6465-4b2b-ab64-3bb956fea451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382941
May 28 14:27:04.564506 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d001800-6559-4d61-9374-1dfe4419e7ad req-ed1b067e-9f6c-403b-a186-56d3eef9eb40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:04.565956 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1d001800-6559-4d61-9374-1dfe4419e7ad req-ed1b067e-9f6c-403b-a186-56d3eef9eb40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0833199
May 28 14:27:04.613211 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1d001800-6559-4d61-9374-1dfe4419e7ad req-fbe53395-c88c-4b9e-ab55-e9257ffed39e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414479
May 28 14:27:04.817391 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['164fd7c8-7a57-4285-93ef-c3fdabceb8be'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:27:05.104323 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 req-b041571d-0396-4371-9b9b-18e38cf75543 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:05.106563 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 req-b041571d-0396-4371-9b9b-18e38cf75543 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 944 time: 0.0883112
May 28 14:27:05.152990 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9eb5c956-6b8c-4fe3-94fd-5514a38b1463 req-fcb57600-f9e1-447c-9c40-7c63d91e2abd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407159
May 28 14:27:05.403402 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:05.420582 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 965a8c13-7f18-4e6d-92f2-16c7c866bcfd up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:27:05.459027 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e56e72-4873-49e9-ac5a-9fc438204990 req-d592ec67-eb44-4255-b5d6-341e15a95195 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:05.462807 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c6e56e72-4873-49e9-ac5a-9fc438204990 req-d592ec67-eb44-4255-b5d6-341e15a95195 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0852263
May 28 14:27:05.515477 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c6e56e72-4873-49e9-ac5a-9fc438204990 req-15be2f02-c94f-481e-a3b6-f83dc2792d4a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0449612
May 28 14:27:05.549339 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a52e780-b6e1-48c1-a050-65d73b853dfc req-09133255-4d2f-49a4-a9f7-fe1b2e1fa2e3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:05.550774 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4a52e780-b6e1-48c1-a050-65d73b853dfc req-09133255-4d2f-49a4-a9f7-fe1b2e1fa2e3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 945 time: 0.0903444
May 28 14:27:05.563323 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:27:05.568548 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:27:05.568928 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:05.595799 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4a52e780-b6e1-48c1-a050-65d73b853dfc req-af23f5d0-4f57-4765-b43a-9963ae0b9a17 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392125
May 28 14:27:05.687674 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:05.715831 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3eac2abf-26a1-4d1d-84ed-ac16a83ef646', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '965a8c13-7f18-4e6d-92f2-16c7c866bcfd'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:27:05.725883 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:05.760004 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3eac2abf-26a1-4d1d-84ed-ac16a83ef646', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'code': 200}
May 28 14:27:05.769122 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:05.771028 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-9a767b18-8e8a-4ba5-9aa6-79f403ae3799 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:05.842183 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04badf5d-4363-47f9-bedd-b981cc90d5cb req-f0c04464-83c8-4a69-adaf-6897aaa90733 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:05.843788 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-04badf5d-4363-47f9-bedd-b981cc90d5cb req-f0c04464-83c8-4a69-adaf-6897aaa90733 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1151164
May 28 14:27:05.860717 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:05.864120 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:05.890742 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-04badf5d-4363-47f9-bedd-b981cc90d5cb req-25c63df4-3c6b-4c10-a84f-6d1aca7f231e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411386
May 28 14:27:06.394409 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b11bf89-83e9-4528-b259-87359ca789cb req-df7b8926-a734-4ec6-8960-aec29facd587 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:06.395888 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b11bf89-83e9-4528-b259-87359ca789cb req-df7b8926-a734-4ec6-8960-aec29facd587 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 1098 time: 0.1445255
May 28 14:27:06.404496 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6fde93-3f77-4282-99ab-14000107fc06 req-9c240425-a3ab-4143-a1f5-cd0cafef2621 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:06.405987 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-de6fde93-3f77-4282-99ab-14000107fc06 req-9c240425-a3ab-4143-a1f5-cd0cafef2621 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.1049750
May 28 14:27:06.482083 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b11bf89-83e9-4528-b259-87359ca789cb req-5431ee22-7069-48cd-a38f-ac7256820960 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0718296
May 28 14:27:06.487515 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-de6fde93-3f77-4282-99ab-14000107fc06 req-49277840-0ad0-4c20-a7a0-677688f2fb9b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0605569
May 28 14:27:06.720729 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 req-6cb73d1d-2c53-455d-b971-93064ac1aebe tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:06.722847 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 req-6cb73d1d-2c53-455d-b971-93064ac1aebe tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0904179
May 28 14:27:06.782505 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-927c11b2-bb4e-460f-b8e4-6cf23707bef8 req-8d432957-0cf3-4d63-8656-56f934426134 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0529702
May 28 14:27:06.791902 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b req-4097fc68-d1f7-4167-b4bf-5373269b0159 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:06.793967 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b req-4097fc68-d1f7-4167-b4bf-5373269b0159 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 945 time: 0.0871325
May 28 14:27:06.845571 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-033fc18b-ed9b-48c0-b8c1-3f1513ea686b req-667da880-7e33-4f1c-af86-09776cc28573 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443728
May 28 14:27:07.092167 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f9b5f1-aef0-4598-83ea-0d7a5187864a req-9ba56cf4-e30d-4404-9fed-a6019c9186d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:07.094075 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-54f9b5f1-aef0-4598-83ea-0d7a5187864a req-9ba56cf4-e30d-4404-9fed-a6019c9186d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0933206
May 28 14:27:07.140813 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-54f9b5f1-aef0-4598-83ea-0d7a5187864a req-9b007a73-d889-471b-a2d1-b235bf518971 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414712
May 28 14:27:07.442519 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 164fd7c8-7a57-4285-93ef-c3fdabceb8be up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:27:07.625034 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 164fd7c8-7a57-4285-93ef-c3fdabceb8be completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:27:07.631034 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 164fd7c8-7a57-4285-93ef-c3fdabceb8be triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:27:07.631971 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:07.793489 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-062284ca-94e9-4b4f-a28c-b88aa8756a27 req-58fb9875-29b9-4a95-b25a-5e0b33780245 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:07.794995 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:07.800945 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-062284ca-94e9-4b4f-a28c-b88aa8756a27 req-58fb9875-29b9-4a95-b25a-5e0b33780245 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.1866992
May 28 14:27:07.836592 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 164fd7c8-7a57-4285-93ef-c3fdabceb8be, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:07.837573 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:27:07.846151 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-062284ca-94e9-4b4f-a28c-b88aa8756a27 req-2c8fd5ae-0ffa-4e56-8afa-5f579a634a6c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440650
May 28 14:27:07.903674 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'code': 200}
May 28 14:27:07.941343 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:07.943522 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-0b462502-0488-4619-ad5c-9a272614279a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:08.050128 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7960afe0-fc0c-42a9-9cdd-924867ca9371 req-d31e6dee-a15e-4024-b5de-384e1ee70fdf tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:08.051827 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7960afe0-fc0c-42a9-9cdd-924867ca9371 req-d31e6dee-a15e-4024-b5de-384e1ee70fdf tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0982893
May 28 14:27:08.055067 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=164fd7c8-7a57-4285-93ef-c3fdabceb8be,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:08.060537 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:08.110606 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7960afe0-fc0c-42a9-9cdd-924867ca9371 req-43130ec6-e425-421f-8bd7-589960143f47 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0481720
May 28 14:27:08.116207 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd req-6a1ebf86-d96c-4fbf-aa4f-6b38d319bff6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:08.119910 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd req-6a1ebf86-d96c-4fbf-aa4f-6b38d319bff6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0972528
May 28 14:27:08.165511 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5cd630c-5fb2-4ed5-af75-f1d1e29a77dd req-cc6f2b23-b818-4440-8eb8-e247e3dd8ffb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394626
May 28 14:27:08.344429 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66804008-0b81-4afe-b384-0c4b2e619f48 req-0fb06786-e185-4a09-98e0-3f8d87172a58 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:08.345880 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-66804008-0b81-4afe-b384-0c4b2e619f48 req-0fb06786-e185-4a09-98e0-3f8d87172a58 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0826447
May 28 14:27:08.390494 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-66804008-0b81-4afe-b384-0c4b2e619f48 req-47f3ec76-44c7-4cc2-a85a-bcd580e991a3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390496
May 28 14:27:09.048546 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d20679-a45a-4a45-9e56-188ecccca691 req-c303d4f1-97b2-4683-9e48-15c7fecfbe46 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:09.050020 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-59d20679-a45a-4a45-9e56-188ecccca691 req-c303d4f1-97b2-4683-9e48-15c7fecfbe46 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.0842843
May 28 14:27:09.097706 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-59d20679-a45a-4a45-9e56-188ecccca691 req-0333d3bc-f6cc-4fb7-825c-79f25bcdfde0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419953
May 28 14:27:09.312377 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9737b1bb-c18c-4201-9c96-c30ac24498dc req-2e38fa38-1f55-47f1-895b-fd2c8c54189b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:09.313923 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9737b1bb-c18c-4201-9c96-c30ac24498dc req-2e38fa38-1f55-47f1-895b-fd2c8c54189b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0937829
May 28 14:27:09.372421 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9737b1bb-c18c-4201-9c96-c30ac24498dc req-4db76a09-3345-4f04-8eec-731ece95f19e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0461035
May 28 14:27:09.392221 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 req-60694292-0296-4d1a-a911-2019739ffce3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:09.393870 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 req-60694292-0296-4d1a-a911-2019739ffce3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.1054547
May 28 14:27:09.444993 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ae2612d8-cd0c-4e8a-8de0-bee13b9d6935 req-11f82e2c-f108-4388-a317-2f79633f518f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446947
May 28 14:27:09.592725 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-063ed975-d7a8-400f-8616-62a7c62647b4 req-3ec43d08-0f1f-4b75-a2b3-92af00d8c9ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:09.594377 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-063ed975-d7a8-400f-8616-62a7c62647b4 req-3ec43d08-0f1f-4b75-a2b3-92af00d8c9ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0813920
May 28 14:27:09.638850 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-063ed975-d7a8-400f-8616-62a7c62647b4 req-bb2d8107-3f2f-4bdc-9123-52bedc7b6feb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391190
May 28 14:27:10.302364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 req-7f673954-bfb0-42d6-a173-43e5a14876a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:10.304628 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 req-7f673954-bfb0-42d6-a173-43e5a14876a6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.0925093
May 28 14:27:10.351138 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4e648d9a-fd76-4e27-be20-0c9c178fd3e2 req-eee69b95-ec4b-4e45-b08d-443bd74d2566 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405924
May 28 14:27:10.661392 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 req-1ee134cb-5949-4b3c-b333-9d954bc6657c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:10.662467 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 req-1ee134cb-5949-4b3c-b333-9d954bc6657c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0910847
May 28 14:27:10.719627 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1aa1d940-8f52-4ff2-86ed-b9396e570a12 req-f1af66e8-bed3-423d-b575-6d487071b0d2 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408471
May 28 14:27:10.727972 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5497e119-25dc-4717-ae50-9230fbcbe5ca req-a1b2404d-7832-4855-ba78-fa0ca8b48784 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:10.729993 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5497e119-25dc-4717-ae50-9230fbcbe5ca req-a1b2404d-7832-4855-ba78-fa0ca8b48784 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.1034141
May 28 14:27:10.796706 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5497e119-25dc-4717-ae50-9230fbcbe5ca req-715139a2-04ce-45e8-bb72-01124c4ea0d0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0602305
May 28 14:27:10.934339 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f136447-278e-4dd5-9fe5-908fad718609 req-4d88ad18-f2f5-46b2-8143-c0398924489c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:10.935847 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6f136447-278e-4dd5-9fe5-908fad718609 req-4d88ad18-f2f5-46b2-8143-c0398924489c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0860214
May 28 14:27:10.983896 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6f136447-278e-4dd5-9fe5-908fad718609 req-cbc8e4d7-c522-421e-9eb5-51b2682c85df tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0424311
May 28 14:27:11.556716 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8dca611-43bb-49f8-9faf-cc1a4e702559 req-03684d9c-a7b1-48f7-9180-c729718fcb9e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:11.558314 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b8dca611-43bb-49f8-9faf-cc1a4e702559 req-03684d9c-a7b1-48f7-9180-c729718fcb9e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.0875039
May 28 14:27:11.606597 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b8dca611-43bb-49f8-9faf-cc1a4e702559 req-0478d690-5202-4f1b-a8cd-b9f35f2bb8db tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422115
May 28 14:27:11.936018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 req-6c664100-6734-46f9-b92c-ef094312ef99 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:11.937507 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 req-6c664100-6734-46f9-b92c-ef094312ef99 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.1078231
May 28 14:27:11.990820 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1bf69d69-2a14-4bca-be4c-fc2e3389cfb6 req-f6cfe921-5ea4-4102-901c-92c8415a7969 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431359
May 28 14:27:12.033231 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c31f814-d5bc-4689-b3ec-f116219585e3 req-f6d40ef4-1677-4222-935e-77c9f49a7a37 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:12.034988 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9c31f814-d5bc-4689-b3ec-f116219585e3 req-f6d40ef4-1677-4222-935e-77c9f49a7a37 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0973456
May 28 14:27:12.083897 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9c31f814-d5bc-4689-b3ec-f116219585e3 req-d4c318bd-3998-4762-85fd-d76afed1d4cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433097
May 28 14:27:12.221130 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 req-68fbfbe3-64ce-4333-88c3-da1bdd4998e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:12.222624 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 req-68fbfbe3-64ce-4333-88c3-da1bdd4998e1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0920568
May 28 14:27:12.270975 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3388ff62-a32e-4672-80b8-64fe67bbc0f0 req-12c53694-51ae-495b-8eda-c15ad8490fbe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416155
May 28 14:27:12.798855 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-373800a0-3543-414d-b5b6-c4329c509564 req-f182da94-3c6f-48e7-8014-d20a1735e68c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:12.800917 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-373800a0-3543-414d-b5b6-c4329c509564 req-f182da94-3c6f-48e7-8014-d20a1735e68c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.0819907
May 28 14:27:12.852119 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-373800a0-3543-414d-b5b6-c4329c509564 req-e355c163-44cf-4048-98b7-9522d0b4f716 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456166
May 28 14:27:13.205918 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72190e74-bad9-4c79-bdae-e2de500667d3 req-e7aae30a-539d-4ba2-bd5b-61be6c016b54 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:13.210887 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-72190e74-bad9-4c79-bdae-e2de500667d3 req-e7aae30a-539d-4ba2-bd5b-61be6c016b54 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.1004016
May 28 14:27:13.277889 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-72190e74-bad9-4c79-bdae-e2de500667d3 req-ad4dd43e-0c55-459a-bf82-757aa71643d1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0633118
May 28 14:27:13.318895 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9704d721-ec8c-4145-ac84-06b18b680f3e req-fe0018a6-2d03-47c9-967b-dbbf30b90ad6 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:13.320444 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9704d721-ec8c-4145-ac84-06b18b680f3e req-fe0018a6-2d03-47c9-967b-dbbf30b90ad6 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.1088901
May 28 14:27:13.372765 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9704d721-ec8c-4145-ac84-06b18b680f3e req-6f80ab39-43a1-4163-b7d9-51d00c73d979 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442495
May 28 14:27:13.502743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 req-1c5ecd5d-38f3-4ab4-8014-acda1b025cfe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:13.510140 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 req-1c5ecd5d-38f3-4ab4-8014-acda1b025cfe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1004558
May 28 14:27:13.560111 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-821be4b3-6ce5-4dbb-8dc0-7923cfc40203 req-c5dc9275-9499-465c-b3a2-88f3c8f0dd0d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0488930
May 28 14:27:14.057625 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54efd833-1663-4df1-80a5-9db80fdb1ed8 req-ff6c6fc3-d05e-4df1-bda7-7025b128d1cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:14.059380 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-54efd833-1663-4df1-80a5-9db80fdb1ed8 req-ff6c6fc3-d05e-4df1-bda7-7025b128d1cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.0924060
May 28 14:27:14.107796 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-54efd833-1663-4df1-80a5-9db80fdb1ed8 req-bebac7ac-4def-4854-b7c5-37603dde5d3d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424869
May 28 14:27:14.485721 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a5335f4-edc1-45f7-a598-b779fb045640 req-41b6d43a-3242-4a18-8fee-aa2bf6a5955a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:14.492853 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3a5335f4-edc1-45f7-a598-b779fb045640 req-41b6d43a-3242-4a18-8fee-aa2bf6a5955a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.1102479
May 28 14:27:14.557018 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3a5335f4-edc1-45f7-a598-b779fb045640 req-478fd73a-d562-448b-bf3f-bdb529b6603a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0632973
May 28 14:27:14.621994 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 req-3dafe71d-3b18-406a-8bb5-b828ea91a16b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:14.624836 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 req-3dafe71d-3b18-406a-8bb5-b828ea91a16b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.1246762
May 28 14:27:14.722066 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f0de4101-f694-4738-916c-b9dc9d0dc9f8 req-0845bac4-a173-4956-8969-0356da8648ed tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0838439
May 28 14:27:14.775746 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 req-fd7bee0b-19f1-43d1-b583-b74984f9fdc1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:14.779536 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 req-fd7bee0b-19f1-43d1-b583-b74984f9fdc1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0941796
May 28 14:27:14.831679 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cd412b7b-a3ea-47a0-ac82-0ce13ccf4dc7 req-8b07c251-62c1-45f9-a1d8-4c4af0e57791 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0470870
May 28 14:27:15.176388 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e885f178-c7c1-447e-aa6a-640ae061b56e req-4355b19d-cf14-44c2-b7ff-0081809d9adf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:15.178018 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e885f178-c7c1-447e-aa6a-640ae061b56e req-4355b19d-cf14-44c2-b7ff-0081809d9adf service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1099 time: 0.0949128
May 28 14:27:15.233120 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e885f178-c7c1-447e-aa6a-640ae061b56e req-ca7dfe03-7b36-4d3c-a51a-f28f6f4fa214 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467489
May 28 14:27:15.349156 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bca39701-e54e-4b5b-ace4-4c0b22793a02 req-b1843c46-1a89-4519-ab3c-4099706c5e62 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:15.349741 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bca39701-e54e-4b5b-ace4-4c0b22793a02 req-b1843c46-1a89-4519-ab3c-4099706c5e62 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.0928359
May 28 14:27:15.412849 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bca39701-e54e-4b5b-ace4-4c0b22793a02 req-62fa18a8-4a02-4d38-a29a-48ce29ba1c64 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0539327
May 28 14:27:15.772232 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068e78a5-be0b-46fc-9eab-047c2030236a req-597dd865-22ea-4fd5-bf1e-7a78e34202bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:15.773890 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-068e78a5-be0b-46fc-9eab-047c2030236a req-597dd865-22ea-4fd5-bf1e-7a78e34202bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0945466
May 28 14:27:15.824204 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-068e78a5-be0b-46fc-9eab-047c2030236a req-bc09941e-5441-4d4a-b78b-45501110d9b6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419598
May 28 14:27:15.955582 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb req-8345cc0d-5eb8-4530-aa87-ebb7005a154b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:15.957322 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb req-8345cc0d-5eb8-4530-aa87-ebb7005a154b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.1219478
May 28 14:27:16.034094 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0dbdcb42-74e8-46b0-a212-5d1eaefc2ecb req-71fb2d63-80e6-47d7-849a-44f1613dc2ed tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0693712
May 28 14:27:16.066748 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 req-e65b2203-3a64-4119-844b-334481098284 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:16.068454 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 req-e65b2203-3a64-4119-844b-334481098284 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.1174667
May 28 14:27:16.128225 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-77d7de46-66cf-4c0d-8ee9-fae5b4178e72 req-973afb9f-9c43-4926-a466-6d8ca2ec69cd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0533619
May 28 14:27:16.696938 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 req-5abb9c00-8e4a-4525-8403-2bbb12e36d1e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:16.698393 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 req-5abb9c00-8e4a-4525-8403-2bbb12e36d1e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.1711910
May 28 14:27:16.745842 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fe4ea743-a649-4dd7-8390-38bac5fd9d44 req-da4442d4-c4fa-445a-b10e-d3b16b43e5ed tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412292
May 28 14:27:17.015499 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-328dddba-9809-4934-9209-3df4f3f8964a req-6f49621d-4237-4f67-b426-fe3e2abf541b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:17.017012 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-328dddba-9809-4934-9209-3df4f3f8964a req-6f49621d-4237-4f67-b426-fe3e2abf541b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0853784
May 28 14:27:17.083530 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-328dddba-9809-4934-9209-3df4f3f8964a req-a7e6762e-6434-48ed-9e65-07c2d7cdb293 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0600948
May 28 14:27:17.301926 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153c78ca-e578-4826-92b9-a739cffa7fb1 req-c88771d6-633c-43db-84a1-ddf4a35bbb0d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:17.304574 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-153c78ca-e578-4826-92b9-a739cffa7fb1 req-c88771d6-633c-43db-84a1-ddf4a35bbb0d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.1300898
May 28 14:27:17.362047 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-153c78ca-e578-4826-92b9-a739cffa7fb1 req-12f85c1e-227c-41fd-b2fb-29f6167dbad2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0505176
May 28 14:27:17.398675 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 req-b4c96155-f09c-4ee2-8de4-749902783267 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:17.400214 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 req-b4c96155-f09c-4ee2-8de4-749902783267 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0931273
May 28 14:27:17.448889 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c0bb9f11-a18a-46b9-9e04-618b5e15a685 req-8a69cd3c-da4a-44d8-acbf-960234a3f7bc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413799
May 28 14:27:17.952123 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7045b2f-7d62-4fa0-99cc-048d62de32aa req-657272fa-8c8f-4cef-be47-e24a246a7e01 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:17.953489 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a7045b2f-7d62-4fa0-99cc-048d62de32aa req-657272fa-8c8f-4cef-be47-e24a246a7e01 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.0845125
May 28 14:27:18.000992 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a7045b2f-7d62-4fa0-99cc-048d62de32aa req-3f317677-66f1-4ec4-a2ce-f5f3e5bac787 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419090
May 28 14:27:18.520248 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a95771dd-f676-48cc-9940-bdb24574ba77 req-7fce8534-8a2f-4d31-b47a-89397b4f793d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:18.528150 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a95771dd-f676-48cc-9940-bdb24574ba77 req-7fce8534-8a2f-4d31-b47a-89397b4f793d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.1458180
May 28 14:27:18.638826 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0110eb7-d48f-443e-9564-b437298aad43 req-1f0c0a4c-bffb-424c-8e21-2601e29282e6 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:18.641107 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a0110eb7-d48f-443e-9564-b437298aad43 req-1f0c0a4c-bffb-424c-8e21-2601e29282e6 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0963013
May 28 14:27:18.690981 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a95771dd-f676-48cc-9940-bdb24574ba77 req-e59d2412-5ea8-4a40-9ccd-d0d2ad425525 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1616373
May 28 14:27:18.696711 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a0110eb7-d48f-443e-9564-b437298aad43 req-b427daf9-c208-41ea-bf21-5da1b7bffabe tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0487142
May 28 14:27:18.890566 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fa4327-1773-460b-95ff-4b5a58a2c041 req-e55ea6da-03dd-40fd-9d8b-eafaf6fd1a6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:18.892739 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d8fa4327-1773-460b-95ff-4b5a58a2c041 req-e55ea6da-03dd-40fd-9d8b-eafaf6fd1a6a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0976944
May 28 14:27:18.945873 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d8fa4327-1773-460b-95ff-4b5a58a2c041 req-725d2651-60c0-429e-9d5a-7597b46407ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0474873
May 28 14:27:19.217721 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 req-f01664d6-fa76-4db0-b7f3-de71b8bfa03f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:19.219206 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 req-f01664d6-fa76-4db0-b7f3-de71b8bfa03f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.0982594
May 28 14:27:19.273773 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5e0595e1-0cd9-49e5-9bd0-357fd43dc443 req-ff1a8aa1-e9d8-4eb5-b48c-032372b24c7f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438113
May 28 14:27:19.888325 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 req-0ebf8867-37e6-488c-a9a9-fe6671224f65 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:19.889800 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 req-0ebf8867-37e6-488c-a9a9-fe6671224f65 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0908022
May 28 14:27:19.915791 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2014004-98d9-4aba-90f3-2c04e9e702e0 req-ecdaa667-fda3-42d8-aaa4-82306116db08 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:19.917431 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e2014004-98d9-4aba-90f3-2c04e9e702e0 req-ecdaa667-fda3-42d8-aaa4-82306116db08 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0830188
May 28 14:27:19.935259 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b99f38d1-7d4b-45e5-ac51-2b77b405ff14 req-68755a12-a263-48b9-a70a-4d48687089b6 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392704
May 28 14:27:19.970149 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e2014004-98d9-4aba-90f3-2c04e9e702e0 req-7b6a30bd-4f22-478e-82d9-bc4d2a3d0581 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0468557
May 28 14:27:20.149108 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 req-d0c3c113-2264-4d67-84e0-c1910c193733 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:20.150630 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 req-d0c3c113-2264-4d67-84e0-c1910c193733 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0878043
May 28 14:27:20.206551 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c6f00ed7-661d-435b-a7b6-f780d6bf2bd7 req-6045c612-4d95-4905-b4a6-c59c246b2b49 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0496974
May 28 14:27:21.130475 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f196094f-93d8-43c9-abb2-a05e0dce5e3c req-4592fcd3-6b89-493b-87b6-5808bf18c9eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:21.131879 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f196094f-93d8-43c9-abb2-a05e0dce5e3c req-4592fcd3-6b89-493b-87b6-5808bf18c9eb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0866020
May 28 14:27:21.158068 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-385898b6-aa24-4429-b115-227935167434 req-4ee96f16-d0bf-4d5e-82cd-29917647b475 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:21.160961 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-385898b6-aa24-4429-b115-227935167434 req-4ee96f16-d0bf-4d5e-82cd-29917647b475 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0827270
May 28 14:27:21.182223 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f196094f-93d8-43c9-abb2-a05e0dce5e3c req-bf84aa70-9d8f-47be-9c1c-ee5ce80a244a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417085
May 28 14:27:21.206907 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-385898b6-aa24-4429-b115-227935167434 req-0ce3c21e-7d2b-45da-be75-4171fd57b30f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412023
May 28 14:27:21.404948 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-373f9481-e9ed-4757-9970-63992f880b0f req-873ec690-f926-4ab7-bdec-3aeb521ff004 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:21.405737 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-373f9481-e9ed-4757-9970-63992f880b0f req-873ec690-f926-4ab7-bdec-3aeb521ff004 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0813920
May 28 14:27:21.453086 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-373f9481-e9ed-4757-9970-63992f880b0f req-211f84e7-be1c-4b1d-b9c1-7db74173e6e3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406158
May 28 14:27:22.375337 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 req-b9ef8541-0e56-4799-83fb-4886339990ea tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:22.376861 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 req-b9ef8541-0e56-4799-83fb-4886339990ea tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0836809
May 28 14:27:22.403412 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eb6cd2-f2d2-4690-b304-92820e850d69 req-8442c494-5990-47c5-ab95-4c5b01e0293d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:22.404957 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-50eb6cd2-f2d2-4690-b304-92820e850d69 req-8442c494-5990-47c5-ab95-4c5b01e0293d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0853472
May 28 14:27:22.422467 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3920ff1a-6fe4-4ebb-940d-ff5dafa3e396 req-bf20ff5a-a319-4087-880e-8fa7607cac58 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397663
May 28 14:27:22.451630 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-50eb6cd2-f2d2-4690-b304-92820e850d69 req-eaba0d55-655a-40b0-be1b-0a852abde829 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408738
May 28 14:27:22.639904 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed918b6-bfef-4db3-88a0-9c321eabe582 req-5e85931c-e4fa-4b4d-b296-33aa669acd0c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:22.641349 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-eed918b6-bfef-4db3-88a0-9c321eabe582 req-5e85931c-e4fa-4b4d-b296-33aa669acd0c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0781116
May 28 14:27:22.684339 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-eed918b6-bfef-4db3-88a0-9c321eabe582 req-eca83d56-7dc5-4126-afd2-a6ba4ca0e2f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0373800
May 28 14:27:23.606374 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 req-67123af0-5db8-4611-9c53-0a4800da80ce tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:23.609694 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 req-67123af0-5db8-4611-9c53-0a4800da80ce tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0844994
May 28 14:27:23.643492 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7427fd74-7199-481c-b155-47969b2efb26 req-30a96110-c25d-4cdf-98e6-4f89e4f665a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:23.644988 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7427fd74-7199-481c-b155-47969b2efb26 req-30a96110-c25d-4cdf-98e6-4f89e4f665a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0880384
May 28 14:27:23.659030 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f21a23e3-5cdc-49f9-b043-4064d1ecf287 req-662c70c0-1c15-4091-a4fb-65b2a70c2547 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436528
May 28 14:27:23.690345 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7427fd74-7199-481c-b155-47969b2efb26 req-22481b3f-1102-46ef-b044-c9492dfdca1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385041
May 28 14:27:23.871780 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 req-aa21c009-92c8-4d6e-ae9a-b6d85ee6ffc0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:23.873263 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 req-aa21c009-92c8-4d6e-ae9a-b6d85ee6ffc0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0817492
May 28 14:27:23.917847 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-79d89d9d-29ca-4b80-b187-8e78ddec3fc9 req-42cdc2e3-d523-4e1e-a6f8-770ee45d93c0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390525
May 28 14:27:24.845766 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7496e4be-5d68-451c-9a10-bad4e177db72 req-7e769fa2-ae89-40fa-bef3-519285c062da tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:24.847253 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7496e4be-5d68-451c-9a10-bad4e177db72 req-7e769fa2-ae89-40fa-bef3-519285c062da tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0816839
May 28 14:27:24.879470 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27092b0-351b-4fef-b576-6e943d8c7a97 req-1204be84-49dc-4c5a-8dbd-f399c9ae2db0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:24.880930 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a27092b0-351b-4fef-b576-6e943d8c7a97 req-1204be84-49dc-4c5a-8dbd-f399c9ae2db0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0830276
May 28 14:27:24.896373 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7496e4be-5d68-451c-9a10-bad4e177db72 req-e957f539-c3df-4170-981d-380dd1659311 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434346
May 28 14:27:24.928029 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a27092b0-351b-4fef-b576-6e943d8c7a97 req-e0b829c5-a967-41e9-92b5-2d63c051e86d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410695
May 28 14:27:25.106413 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 req-65bb706d-363c-41f4-93a5-2e9adfc82c9b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:25.107912 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 req-65bb706d-363c-41f4-93a5-2e9adfc82c9b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0788770
May 28 14:27:25.152264 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ec595f2a-b29c-4f09-b4be-3e8d7d407cd8 req-9628f363-ec4a-4e2e-af9f-a284d3da38c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381057
May 28 14:27:26.108151 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 req-f98f0959-7b58-4ecf-8e5a-3c96fff1403e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:26.109678 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 req-f98f0959-7b58-4ecf-8e5a-3c96fff1403e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0932167
May 28 14:27:26.121601 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 req-f0420cd7-b509-411e-9102-6a9a97a69769 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:26.123056 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 req-f0420cd7-b509-411e-9102-6a9a97a69769 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0900085
May 28 14:27:26.155915 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3f7545f8-a1cc-404c-8676-bdb72a1e5286 req-67747db7-1c06-473e-9a9a-ca357b2d714e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403144
May 28 14:27:26.167266 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d7d109e9-e820-42bb-90ed-7a1e982e3a10 req-e2741b30-e10a-42c4-9262-ad6485e5f7bd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385845
May 28 14:27:26.340455 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a672da-5364-4d3d-849e-b8add967e5de req-edb46f23-6414-48d2-97c6-44688869bf46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:26.341819 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-65a672da-5364-4d3d-849e-b8add967e5de req-edb46f23-6414-48d2-97c6-44688869bf46 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0828450
May 28 14:27:26.386314 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-65a672da-5364-4d3d-849e-b8add967e5de req-eed992dd-61c5-4752-8f2f-703ddf3df1f6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383027
May 28 14:27:27.344274 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb req-711a11ac-78f6-4798-83ad-2e283b07f195 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:27.345662 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb req-711a11ac-78f6-4798-83ad-2e283b07f195 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0809457
May 28 14:27:27.360977 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 req-bd03e1d2-f60a-447c-963b-5c6336feb2a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:27.362427 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 req-bd03e1d2-f60a-447c-963b-5c6336feb2a9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0795944
May 28 14:27:27.392026 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-27ce71b2-96dd-4bbf-b37e-2609981aa4eb req-181cc9bc-82cf-46e7-86ad-dfcf1be2b523 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406370
May 28 14:27:27.416367 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c16fa90e-e4b1-4e66-ad89-2b6b8c050a55 req-80581db7-57cd-46e3-a829-bfe72706cd9e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0478480
May 28 14:27:27.578401 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e req-7ff4e210-0905-4e36-b3d2-e121c70ed0c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:27.579923 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e req-7ff4e210-0905-4e36-b3d2-e121c70ed0c1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0829852
May 28 14:27:27.633663 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d29514fb-8d0c-41ad-8ed6-d72cb2604d2e req-af4e7132-6f59-40ce-a537-26b101b9509c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0420709
May 28 14:27:27.843304 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:28.588141 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d req-bca70ed1-2613-4360-9f0f-cb84bee83cee tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:28.590303 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d req-bca70ed1-2613-4360-9f0f-cb84bee83cee tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0899825
May 28 14:27:28.637439 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-abdd26e2-48f1-43f1-9196-04b9d4c7f22d req-fc6d5a15-e673-49b6-9c32-c636405774f5 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414310
May 28 14:27:28.655796 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 req-5b06d2a0-9500-49f8-b0b5-f0fdb2723bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:28.657296 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 req-5b06d2a0-9500-49f8-b0b5-f0fdb2723bf5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.1382484
May 28 14:27:28.705456 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-9e2ce513-ee7b-4d40-9c7c-379b99d5968b service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1173484
May 28 14:27:28.716271 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6eb2a63b-7e1f-43f2-99ef-574e029e4041 req-e0f8dd51-4b62-444b-9257-526659bae151 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0481610
May 28 14:27:28.844624 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee req-94849102-f99d-4e3f-b43f-334589cf6166 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:28.846073 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee req-94849102-f99d-4e3f-b43f-334589cf6166 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0860803
May 28 14:27:28.890400 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8d70464a-7ad5-41d2-b99d-c7a7e66fe9ee req-7641d907-0167-40d8-9a47-7d6b199de729 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386543
May 28 14:27:28.955658 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-29b4037e-7a00-487b-a9e6-e553c0c77c81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:28.957111 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-29b4037e-7a00-487b-a9e6-e553c0c77c81 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=1db248e02dac49bf8688658eb42ee752&device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 1099 time: 0.0730751
May 28 14:27:29.821673 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e598b1-4820-4bf9-b7b1-89a95b97f287 req-a29583cb-47c0-4eb3-8ad8-de85dd5691cc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:29.823683 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-78e598b1-4820-4bf9-b7b1-89a95b97f287 req-a29583cb-47c0-4eb3-8ad8-de85dd5691cc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0800064
May 28 14:27:29.867821 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-78e598b1-4820-4bf9-b7b1-89a95b97f287 req-274a3c34-61ad-46b4-8871-569adf92372f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385172
May 28 14:27:30.019053 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a66380fd-fcbf-4604-9bf6-803caa14e322 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:30.107911 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e413a341-fae2-42e9-bf21-f842a7a9de12 req-e650f567-c9f2-4a2c-b2bb-de5147c923d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:30.109318 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e413a341-fae2-42e9-bf21-f842a7a9de12 req-e650f567-c9f2-4a2c-b2bb-de5147c923d9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.1474743
May 28 14:27:30.153469 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e413a341-fae2-42e9-bf21-f842a7a9de12 req-1e4aef28-bfca-45da-b3a4-edc6d0175346 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385525
May 28 14:27:30.329716 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f787916d-a47f-47b5-aee8-309b5c4487b3 req-f727f38f-1f9f-4865-b137-07766a2a0c22 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:30.331052 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f787916d-a47f-47b5-aee8-309b5c4487b3 req-f727f38f-1f9f-4865-b137-07766a2a0c22 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0804460
May 28 14:27:30.378100 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f787916d-a47f-47b5-aee8-309b5c4487b3 req-830ccbb0-5cf6-40d5-b117-bedddf50c160 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414534
May 28 14:27:30.539817 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:27:30.551004 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150def93-92cd-48a8-998e-7007845bfbbd req-797171dc-7de2-4a43-a4ac-9f61764e862a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:30.552486 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-150def93-92cd-48a8-998e-7007845bfbbd req-797171dc-7de2-4a43-a4ac-9f61764e862a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0797086
May 28 14:27:30.597269 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-150def93-92cd-48a8-998e-7007845bfbbd req-417be523-467b-4f21-9e1f-fc65c55e0305 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385578
May 28 14:27:30.981870 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52207e3c-8aa2-4c0d-a376-714c5386b26e req-8f86b0ff-60c3-4d07-806a-6631b1708b83 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:30.983307 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-52207e3c-8aa2-4c0d-a376-714c5386b26e req-8f86b0ff-60c3-4d07-806a-6631b1708b83 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0872614
May 28 14:27:31.027011 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-52207e3c-8aa2-4c0d-a376-714c5386b26e req-0378caae-c3be-4564-b289-9895f209dd0b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0374889
May 28 14:27:31.335892 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 req-ee42f360-2267-4410-93e2-8999dd1c1eb3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:31.337322 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 req-ee42f360-2267-4410-93e2-8999dd1c1eb3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0794587
May 28 14:27:31.382665 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e1703fc8-ec5f-4e8a-a0a0-c1d6d7c9d7b3 req-ddc88f4c-c40e-4522-a0cb-274585b8c0ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391595
May 28 14:27:31.788394 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cab14c8-5727-4a41-a75b-ae4094d937f8 req-e254a082-6541-42e7-ba97-fa9b65dfaeef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:31.789347 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7cab14c8-5727-4a41-a75b-ae4094d937f8 req-e254a082-6541-42e7-ba97-fa9b65dfaeef tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0841632
May 28 14:27:31.845816 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7cab14c8-5727-4a41-a75b-ae4094d937f8 req-19497f90-4fbd-4aa9-9933-3185577f8ed1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0452046
May 28 14:27:32.511958 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:32.523077 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8fceff78-0db0-475a-878a-45d108a46190 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:32.579513 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06dd97a7-250b-4031-b18d-89cd975d6389 req-173f0892-3a29-42ad-b4bb-8d1d15f0daa8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:32.581257 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-06dd97a7-250b-4031-b18d-89cd975d6389 req-173f0892-3a29-42ad-b4bb-8d1d15f0daa8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0903995
May 28 14:27:32.635073 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-fe8994ed-d3c9-492e-9a18-0d8762ee074f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:32.636594 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-fe8994ed-d3c9-492e-9a18-0d8762ee074f service neutron] 10.222.0.90 "GET /v2.0/networks?id=8023cc33-82ed-49b2-a8e8-69839a1ff66e HTTP/1.1" status: 200  len: 913 time: 0.1355724
May 28 14:27:32.640366 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-06dd97a7-250b-4031-b18d-89cd975d6389 req-63ba5cdf-c262-4757-9331-1e5b3cbf2fd0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0527840
May 28 14:27:33.036514 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8378dd7f-b848-4231-9ced-a806164e9031 req-ad14f5dc-d549-4a32-9faf-cb851fccdf8b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:33.037949 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8378dd7f-b848-4231-9ced-a806164e9031 req-ad14f5dc-d549-4a32-9faf-cb851fccdf8b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0783851
May 28 14:27:33.081075 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8378dd7f-b848-4231-9ced-a806164e9031 req-0930d469-4acc-4201-842b-7b824f6169c5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0368471
May 28 14:27:33.706414 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:33.824295 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb req-5d6e31e8-5c44-40c9-ad14-68a11caabda2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:33.825873 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb req-5d6e31e8-5c44-40c9-ad14-68a11caabda2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0847352
May 28 14:27:33.870695 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-23e55aa0-c487-4b03-8ff0-9dedd08ed1fb req-a7577cb8-5842-43e8-8d8d-03e636ff0948 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391285
May 28 14:27:34.273468 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47933de8-287a-47fb-9a7f-1c9c1f01190a req-230582cc-cad7-46b2-8443-57be80d4f1b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:34.275114 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-47933de8-287a-47fb-9a7f-1c9c1f01190a req-230582cc-cad7-46b2-8443-57be80d4f1b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 945 time: 0.0820692
May 28 14:27:34.319649 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-47933de8-287a-47fb-9a7f-1c9c1f01190a req-95042215-f91a-45b3-b20d-6c6f318f5fca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383182
May 28 14:27:34.481843 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-91b93be4-940a-4a80-a6cf-723387e9b380 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=15e73ba1-bc57-49ac-bae9-9906c3fe9522 HTTP/1.1" status: 200  len: 217 time: 0.0616889
May 28 14:27:34.483071 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:27:34.601005 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:34.630019 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:27:34.638987 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-d210ded3-cd70-4ec9-b208-4f3632c00760 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:34.643724 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-d210ded3-cd70-4ec9-b208-4f3632c00760 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=00f80d27-adb3-4b05-9355-ad0adc3a3490 HTTP/1.1" status: 200  len: 852 time: 0.1480436
May 28 14:27:34.644190 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:34.675179 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'code': 200}
May 28 14:27:34.690923 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-55a4efcc-a67f-4815-ab53-10476b9c8d05 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=8023cc33-82ed-49b2-a8e8-69839a1ff66e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0408857
May 28 14:27:34.715828 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:34.717726 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:34.789973 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=8']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:34.793855 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:34.831919 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-6531857c-5aed-4636-8117-86ece11ba8bc service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1317019
May 28 14:27:34.978518 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-462d1aca-19cd-4b4c-a69b-83666071b768 req-3e069b8f-19e3-4568-94bb-66d77ef4e7e7 service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1347678
May 28 14:27:35.071936 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c297b6da-4d13-4807-9f1a-201e00cf70d9 req-47eb1e2e-688e-400c-a625-17b78b87b550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:35.073506 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c297b6da-4d13-4807-9f1a-201e00cf70d9 req-47eb1e2e-688e-400c-a625-17b78b87b550 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0865159
May 28 14:27:35.127755 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c297b6da-4d13-4807-9f1a-201e00cf70d9 req-78592153-c372-46d3-a5ce-7914faa0e061 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0474823
May 28 14:27:35.140342 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-3df07625-4b94-4ac5-8b20-08a07491f714 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:35.141809 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-3df07625-4b94-4ac5-8b20-08a07491f714 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1096 time: 0.0816443
May 28 14:27:35.293713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-2780759c-f9f1-40c7-a78e-6c74b5043f6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:35.295301 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-2780759c-f9f1-40c7-a78e-6c74b5043f6e service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.1330562
May 28 14:27:35.323491 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:35.460988 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-e1f36023-77c8-4d2e-8265-e94591078a42 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 200  len: 999 time: 0.1147022
May 28 14:27:35.515031 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 req-d844488a-82c5-443c-ae07-0a543d962cf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:35.516551 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 req-d844488a-82c5-443c-ae07-0a543d962cf2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0832536
May 28 14:27:35.549837 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-f3a14be7-0d1a-4dd5-b9b3-0d279356e66e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:35.551255 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-f3a14be7-0d1a-4dd5-b9b3-0d279356e66e service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.0828526
May 28 14:27:35.562115 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-065dba4e-e08e-4112-9d5a-4b0ba63723d7 req-3cfde02a-a727-4f9f-9cc2-2239c6ea3243 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398903
May 28 14:27:35.633442 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-dfc36e43-a63e-4b15-96da-05bae75790df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:35.634902 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-dfc36e43-a63e-4b15-96da-05bae75790df service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0712905
May 28 14:27:35.776890 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-3056deb9-ca6d-4b07-8eec-063d7ab1b725 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1318173
May 28 14:27:35.919485 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c3f5f37a-05e1-4c33-be89-c7b462e07430 req-4e2d7057-de34-4080-b8b5-ad87f91baf82 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1312857
May 28 14:27:36.320831 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f req-dfbcc459-a9bf-4109-bc8d-9a3c1e8e5982 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:36.322303 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f req-dfbcc459-a9bf-4109-bc8d-9a3c1e8e5982 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0820899
May 28 14:27:36.377291 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1d310a0-0bd1-43ec-ac00-3024aa620a9f req-58632e36-3b39-4885-aaa2-83041a4aae30 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0477796
May 28 14:27:36.761657 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c942a9e-0963-47bb-9f9b-a93391141ef4 req-b0a96a9b-3674-4ce9-999a-0e07ede1171d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:36.763273 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0c942a9e-0963-47bb-9f9b-a93391141ef4 req-b0a96a9b-3674-4ce9-999a-0e07ede1171d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0865111
May 28 14:27:36.810792 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0c942a9e-0963-47bb-9f9b-a93391141ef4 req-e2b7103d-e327-4d00-a2e7-bc3d0db5caa4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418861
May 28 14:27:37.565635 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee49d0a2-b921-4e98-b262-9835c77ba91c req-40562008-de9c-4309-9104-dac1d5e5e3b5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:37.567079 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ee49d0a2-b921-4e98-b262-9835c77ba91c req-40562008-de9c-4309-9104-dac1d5e5e3b5 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 943 time: 0.0786905
May 28 14:27:37.612031 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ee49d0a2-b921-4e98-b262-9835c77ba91c req-f863ab92-61cd-43c6-bbea-0fd3b8eb1a14 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390928
May 28 14:27:38.005829 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 req-f32a4230-ede9-4da1-ab6f-1d85a4a28e6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:38.013031 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 req-f32a4230-ede9-4da1-ab6f-1d85a4a28e6f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0818684
May 28 14:27:38.064795 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-51ac0efe-f2d8-4c84-bf4f-e9cdb41c4079 req-b9226d35-0532-40e2-834d-effc5c4bd4f2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0510213
May 28 14:27:38.479828 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 4b79b510-d52c-4720-bf56-28c541fff0b4 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:27:38.615744 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 4b79b510-d52c-4720-bf56-28c541fff0b4, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=4b79b510-d52c-4720-bf56-28c541fff0b4,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:38.629512 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'port_id': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'mac_address': 'fa:16:3e:1b:c1:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 867, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:27:38.686998 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:38.703651 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b79b510-d52c-4720-bf56-28c541fff0b4 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:27:38.718778 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 4b79b510-d52c-4720-bf56-28c541fff0b4, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=4b79b510-d52c-4720-bf56-28c541fff0b4,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:38.875595 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:38.877739 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:38.946675 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=4b79b510-d52c-4720-bf56-28c541fff0b4,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:38.952224 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:39.412274 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c47a160-2990-46c3-b57a-cda41e8e4b76 req-16deeb8d-e15f-48a8-b3de-2fa73416c46a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:39.413744 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0c47a160-2990-46c3-b57a-cda41e8e4b76 req-16deeb8d-e15f-48a8-b3de-2fa73416c46a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 944 time: 0.0880241
May 28 14:27:39.425553 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['4b79b510-d52c-4720-bf56-28c541fff0b4'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:27:39.461252 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0c47a160-2990-46c3-b57a-cda41e8e4b76 req-c1dd8420-ce23-428c-b135-24800f0e2811 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408299
May 28 14:27:40.220483 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd32f2f7-f021-466c-98f5-316ebc192aef req-b0fce2b9-2360-424e-bc21-9790ca39d891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:40.220483 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cd32f2f7-f021-466c-98f5-316ebc192aef req-b0fce2b9-2360-424e-bc21-9790ca39d891 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0832157
May 28 14:27:40.261732 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cd32f2f7-f021-466c-98f5-316ebc192aef req-16700446-dde9-4f0b-a0a5-5a50b79fea11 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0424092
May 28 14:27:40.478809 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:27:40.679057 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 36484) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:27:40.694764 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e135b6-da9e-4026-b4ea-226df299b9a9 req-a7657a24-d580-49a1-bb88-51e2a2a9a3a4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:40.696332 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-16e135b6-da9e-4026-b4ea-226df299b9a9 req-a7657a24-d580-49a1-bb88-51e2a2a9a3a4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 944 time: 0.1096179
May 28 14:27:40.765140 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-16e135b6-da9e-4026-b4ea-226df299b9a9 req-712f5a76-503f-456e-9f3c-ce2452e20a96 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0613356
May 28 14:27:40.830472 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-43b2078c-e54a-4712-b170-3a0552cd5a4b service neutron] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1495192
May 28 14:27:41.458571 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-987dec68-b5b2-4cd5-9f29-f6932e463e47 req-c0a53498-36bb-416f-b8bd-5c82c26492f6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:41.460024 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-987dec68-b5b2-4cd5-9f29-f6932e463e47 req-c0a53498-36bb-416f-b8bd-5c82c26492f6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0840769
May 28 14:27:41.508783 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-987dec68-b5b2-4cd5-9f29-f6932e463e47 req-72002e65-9097-45d7-9d70-2936b8e64df3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407193
May 28 14:27:41.949953 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a41d036e-af51-47d4-b4f6-5424b970c8d7 req-016a6d54-9460-4f9c-b7a3-4211359f7c0e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:41.952963 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a41d036e-af51-47d4-b4f6-5424b970c8d7 req-016a6d54-9460-4f9c-b7a3-4211359f7c0e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 944 time: 0.0900636
May 28 14:27:42.001549 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a41d036e-af51-47d4-b4f6-5424b970c8d7 req-76d60257-27c8-441d-a301-3e1ffd99d91a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412581
May 28 14:27:42.475421 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 4b79b510-d52c-4720-bf56-28c541fff0b4 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:27:42.630221 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 4b79b510-d52c-4720-bf56-28c541fff0b4 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:27:42.636343 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 4b79b510-d52c-4720-bf56-28c541fff0b4 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:27:42.636343 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:42.715899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4141dfe-b50a-4364-a62e-c3739ed905e6 req-b76c2769-be5d-4a7a-8772-c9784445516f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:42.717397 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f4141dfe-b50a-4364-a62e-c3739ed905e6 req-b76c2769-be5d-4a7a-8772-c9784445516f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0946462
May 28 14:27:42.762357 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f4141dfe-b50a-4364-a62e-c3739ed905e6 req-77c1a7dd-e827-447d-89f3-bdaa0cc5d0c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388865
May 28 14:27:42.766219 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:42.794114 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b79b510-d52c-4720-bf56-28c541fff0b4'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:27:42.804451 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 4b79b510-d52c-4720-bf56-28c541fff0b4, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=4b79b510-d52c-4720-bf56-28c541fff0b4,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:27:42.838920 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'code': 200}
May 28 14:27:42.901206 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:42.903542 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:42.971113 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=4b79b510-d52c-4720-bf56-28c541fff0b4,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:42.974453 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:43.320089 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76efefb0-11af-4e3e-9900-8c9cfc0e7f5f req-3c0fab99-189e-4136-8d93-8605cabb3663 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:43.321443 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76efefb0-11af-4e3e-9900-8c9cfc0e7f5f req-3c0fab99-189e-4136-8d93-8605cabb3663 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 1098 time: 0.0959694
May 28 14:27:43.329919 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea086567-20ff-4df3-b632-0760b929f240 req-1b2398f4-830c-4b15-918b-fa0b5aabd747 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:43.331237 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ea086567-20ff-4df3-b632-0760b929f240 req-1b2398f4-830c-4b15-918b-fa0b5aabd747 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 945 time: 0.2209487
May 28 14:27:43.401165 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ea086567-20ff-4df3-b632-0760b929f240 req-3dbc1b5b-bd89-46d4-bc4b-0d30a2ae1e5a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0641129
May 28 14:27:43.404332 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76efefb0-11af-4e3e-9900-8c9cfc0e7f5f req-ef65ed63-8a1a-48f4-8f32-d3c7c4861fd4 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0542779
May 28 14:27:43.955989 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 req-0096c346-b690-4bef-8b7e-866decb793f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:43.957427 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 req-0096c346-b690-4bef-8b7e-866decb793f5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0826268
May 28 14:27:44.002674 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ca8e41d2-ae4f-4eff-beaf-c05bf5131cc2 req-6ef52a3a-0370-4f8d-854a-4c209ebcd3ff tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395238
May 28 14:27:44.580754 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-693f4747-5a83-443a-9f8a-75355e201100 req-14911fd5-84b5-4c5f-9e02-c6e0699f52a1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:44.582112 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-693f4747-5a83-443a-9f8a-75355e201100 req-14911fd5-84b5-4c5f-9e02-c6e0699f52a1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 945 time: 0.0784810
May 28 14:27:44.630205 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-693f4747-5a83-443a-9f8a-75355e201100 req-4209cc71-dbfb-4bc2-9cf3-43f90dc93bd1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425239
May 28 14:27:45.201141 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 req-95f48153-4eb0-4ca3-924a-3b8790a9e539 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:45.202635 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 req-95f48153-4eb0-4ca3-924a-3b8790a9e539 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0816364
May 28 14:27:45.255669 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a6ced0ae-b37c-4261-ab3a-fca4f29c96d0 req-e5f89605-5c50-480b-a0ef-41d3f9f172b0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0473249
May 28 14:27:45.812468 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a req-4dfbc49d-85a3-462d-8eae-1ad329af3d5f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:45.813991 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a req-4dfbc49d-85a3-462d-8eae-1ad329af3d5f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 945 time: 0.0804925
May 28 14:27:45.858368 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-28e834a9-54ad-4c2c-809c-b2df9afd2b1a req-66022fb1-5568-46a3-9ae9-e496ae891c68 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385389
May 28 14:27:46.104191 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 req-9eacfa3d-1a66-40b7-b1fe-376b332cea94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:46.105649 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 req-9eacfa3d-1a66-40b7-b1fe-376b332cea94 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 945 time: 0.1432526
May 28 14:27:46.149286 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1ba82bb8-2fd9-46e4-b18d-083c359054f1 req-a03f6ee7-d487-4a52-8c21-d668c7f530ce tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0380385
May 28 14:27:46.178559 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 36560) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:27:46.372719 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-415a80fa-3b5b-4eeb-81e5-be5351ec0d4d tempest-TestVolumeBootPattern-2072041258 tempest-TestVolumeBootPattern-2072041258-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:46.373427 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-415a80fa-3b5b-4eeb-81e5-be5351ec0d4d tempest-TestVolumeBootPattern-2072041258 tempest-TestVolumeBootPattern-2072041258-project-admin] Synchronizing usage tracker for tenant:ad1c8d68ed024b78a40404830469679a on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:27:46.456461 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-415a80fa-3b5b-4eeb-81e5-be5351ec0d4d tempest-TestVolumeBootPattern-2072041258 tempest-TestVolumeBootPattern-2072041258-project-admin] Unset dirty status for tenant:ad1c8d68ed024b78a40404830469679a on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:27:46.460265 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-415a80fa-3b5b-4eeb-81e5-be5351ec0d4d tempest-TestVolumeBootPattern-2072041258 tempest-TestVolumeBootPattern-2072041258-project-admin] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 1093 time: 0.2781699
May 28 14:27:46.460620 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 36572) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:27:46.466051 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'floatingip': {'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'port_id': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address': '172.20.0.9'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:27:46.472244 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:27:46.477538 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:floatingip and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:27:46.480990 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:27:46.484804 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9996133-ec4a-4c94-bf52-84c711ec626a req-5f9bdd85-03bc-4d68-aeda-1d692e2736b6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:46.488018 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:27:46.492579 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a9996133-ec4a-4c94-bf52-84c711ec626a req-5f9bdd85-03bc-4d68-aeda-1d692e2736b6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0999484
May 28 14:27:46.536260 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a9996133-ec4a-4c94-bf52-84c711ec626a req-03852951-4cd9-4b9c-8488-f6c7cae35423 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428379
May 28 14:27:46.559947 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:46.698769 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:46.840332 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Allocated IP 172.27.3.250 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/c83e9b0d-58cd-4718-9eef-a9919d363659) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:27:46.989622 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:47.077761 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:47.081742 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:47.153615 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:27:47.156556 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:27:47.159036 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:27:47.197086 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'Port': ['ID=c83e9b0d-58cd-4718-9eef-a9919d363659,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:47.212547 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.212926 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.213845 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.214201 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.214556 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.214907 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.215254 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.215624 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.215972 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.216317 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.216657 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.216996 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:27:47.221615 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:47.631634 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:47.730596 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7c9f69-e12d-4078-bd3a-e424971e86e2 req-22f6d4c1-17f6-4830-bad8-4fe6a0770452 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:47.732105 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-af7c9f69-e12d-4078-bd3a-e424971e86e2 req-22f6d4c1-17f6-4830-bad8-4fe6a0770452 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0799046
May 28 14:27:47.818487 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-af7c9f69-e12d-4078-bd3a-e424971e86e2 req-86180831-6c72-4074-85c9-52200d5579bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0806415
May 28 14:27:47.831313 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:48.036123 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:48.118216 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:48.123818 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:48.317101 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'Port': ['ID=c83e9b0d-58cd-4718-9eef-a9919d363659,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:27:48.321158 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:27:48.326215 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:48.498467 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.l3_db [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Floating IP 854345b8-80df-4572-a7ab-7dc03f1483b1 associated. External IP: 172.27.3.250, port: 4b79b510-d52c-4720-bf56-28c541fff0b4.
May 28 14:27:48.849085 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Router 0cb62432-a4fe-4ba8-9099-f616594e4211 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:27:49.010735 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f78efc19-d2a6-414e-a32b-55b1408b06af req-b5dbba0d-1ca8-4cfb-87c2-fef2a711ced0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:49.012214 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f78efc19-d2a6-414e-a32b-55b1408b06af req-b5dbba0d-1ca8-4cfb-87c2-fef2a711ced0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0844162
May 28 14:27:49.028697 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:27:49.039373 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] Sync routers for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:27:49.051045 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:27:49.051508 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba21d7f70>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:27:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:27:49.059048 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f78efc19-d2a6-414e-a32b-55b1408b06af req-bf733d28-cfbd-4576-b674-e0640874e5ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408368
May 28 14:27:49.132454 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:49.194412 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.7325261
May 28 14:27:49.195514 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'tag': '4b79b510-d52c-4720-bf56-28c541fff0b4'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:27:49.229886 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:27:49.300082 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'tag': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'status': 'completed', 'code': 200}
May 28 14:27:49.602044 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba21d7f70>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '854345b8-80df-4572-a7ab-7dc03f1483b1', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.250', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 503, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:1b:c1:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:27:47Z', 'updated_at': '2021-05-28T14:27:47Z', 'revision_number': 0, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:27:49.607418 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] Checking router: 0cb62432-a4fe-4ba8-9099-f616594e4211 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:27:49.615368 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:27:49.615970 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba21d7f70>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:27:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:27:49.792265 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:27:50.145209 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba21d7f70>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '854345b8-80df-4572-a7ab-7dc03f1483b1', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.250', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 503, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:1b:c1:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:27:47Z', 'updated_at': '2021-05-28T14:27:47Z', 'revision_number': 0, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:27:50.149284 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a1609c4-37f9-4d00-8185-a2fc9a27f581 None None] The sync data for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi is: [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '854345b8-80df-4572-a7ab-7dc03f1483b1', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.250', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 503, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:1b:c1:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:27:47Z', 'updated_at': '2021-05-28T14:27:47Z', 'revision_number': 0, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:27:50.250496 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78a928-9117-4ca9-b7e4-9d0606652f5a req-bcc84120-b56e-4c01-9dbf-5c6df3573ec0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:50.252003 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f78a928-9117-4ca9-b7e4-9d0606652f5a req-bcc84120-b56e-4c01-9dbf-5c6df3573ec0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0819263
May 28 14:27:50.301171 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f78a928-9117-4ca9-b7e4-9d0606652f5a req-1c99e48f-c677-4942-a915-7b6ffc4bd6cc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0433331
May 28 14:27:50.342782 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35d7083a-ead3-4162-b8ab-386fd9eb7608 None None] New status for floating IP 854345b8-80df-4572-a7ab-7dc03f1483b1: ACTIVE {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:27:51.274387 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-1efd9635-e127-483a-b333-ab53182592c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:51.276498 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-1efd9635-e127-483a-b333-ab53182592c8 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 1098 time: 0.0761399
May 28 14:27:51.493422 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6880c9-8122-4140-bf85-58e549753a02 req-13d8bc28-6183-465a-a849-bed39983232f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:51.495846 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bd6880c9-8122-4140-bf85-58e549753a02 req-13d8bc28-6183-465a-a849-bed39983232f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0808411
May 28 14:27:51.538354 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bd6880c9-8122-4140-bf85-58e549753a02 req-b9693a8f-c867-4517-9c87-029dd2942da8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0369296
May 28 14:27:52.724601 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c56b553-7f7b-4707-880a-5674a4babf0e req-62732f4c-78b7-40df-98cc-87a53a6d3e74 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:52.726025 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7c56b553-7f7b-4707-880a-5674a4babf0e req-62732f4c-78b7-40df-98cc-87a53a6d3e74 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0777006
May 28 14:27:52.770444 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7c56b553-7f7b-4707-880a-5674a4babf0e req-54565c89-cae9-40b7-ba1b-b9ccd4c0a831 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383060
May 28 14:27:53.180616 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-c92de060-6ef4-4c7a-b995-1eb26fa5de7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:53.182104 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-c92de060-6ef4-4c7a-b995-1eb26fa5de7e service neutron] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 913 time: 0.1268981
May 28 14:27:53.305137 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-0786e94a-7114-45b3-8880-1147bfc545d7 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4b79b510-d52c-4720-bf56-28c541fff0b4 HTTP/1.1" status: 200  len: 1001 time: 0.1010342
May 28 14:27:53.371342 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-4896c673-e26c-4277-b410-5f74444d3a46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:53.372655 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-4896c673-e26c-4277-b410-5f74444d3a46 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.0596931
May 28 14:27:53.454876 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-d983d30c-483e-43ef-89f9-c8981c9e0ff4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:53.456351 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-d983d30c-483e-43ef-89f9-c8981c9e0ff4 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0700755
May 28 14:27:53.595096 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-07851f8b-0808-47e6-b2c9-be0197178716 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1249607
May 28 14:27:53.746102 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51f23391-1566-4f24-b6eb-26c7c0af2e15 req-63c9a68e-7f6b-4a63-afc7-011814c82e4a service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1265469
May 28 14:27:53.968020 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 req-3cde3a69-439b-492d-a6f1-fab6d27d063e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:53.969482 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 req-3cde3a69-439b-492d-a6f1-fab6d27d063e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0871496
May 28 14:27:54.017583 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-080e88f2-179a-42ac-babb-0c8a1ac2c8b4 req-ff878224-dbcc-4542-8325-f315e44af016 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419898
May 28 14:27:55.215451 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 req-01937dc2-87e9-4566-9085-035580426717 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:55.216995 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 req-01937dc2-87e9-4566-9085-035580426717 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0832837
May 28 14:27:55.341304 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6c9ef32d-ad0a-4bb3-a833-f98583ef6fa5 req-0bb8bdef-6d46-40fc-bfe6-eb40a5b538e7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1185923
May 28 14:27:55.679174 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-bc9f9600-13a7-4c01-b709-669290f8e826 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:55.679881 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-bc9f9600-13a7-4c01-b709-669290f8e826 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:network {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:27:55.860587 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-bc9f9600-13a7-4c01-b709-669290f8e826 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:network {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:27:55.861764 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-bc9f9600-13a7-4c01-b709-669290f8e826 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/networks?id=37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 200  len: 814 time: 0.3267944
May 28 14:27:55.879710 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-0567fb66-7240-4a23-8760-f3b6127393db tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/quotas/94dc9f7ad5dd40429991c68c00e7ec6d HTTP/1.1" status: 200  len: 375 time: 0.0102091
May 28 14:27:55.960597 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-fd8a34ff-c74d-4261-80a9-967a2e57625f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&fields=id HTTP/1.1" status: 200  len: 255 time: 0.0755267
May 28 14:27:56.146217 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-f4a0ddec-b242-4f8e-97f6-ccf6471b3c01 service neutron] 10.222.0.59 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1786969
May 28 14:27:56.389502 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-dfb2850d-09be-49cb-b862-cc4af6a5ef7e service neutron] 10.222.0.59 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2366703
May 28 14:27:56.537019 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8223923-ee3d-4f57-a749-9934ebbf85c8 req-6cfa6f74-a517-4cb6-84e8-2bf535298a68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:56.538469 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f8223923-ee3d-4f57-a749-9934ebbf85c8 req-6cfa6f74-a517-4cb6-84e8-2bf535298a68 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0821412
May 28 14:27:56.583770 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f8223923-ee3d-4f57-a749-9934ebbf85c8 req-4a8c2d70-9427-4016-89ed-90b043d2f5a4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386844
May 28 14:27:56.709928 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5c215399-759e-41f5-b757-6f6a24f2505a req-1162428b-4663-44a5-b3e8-16f2cdc3f2b6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 210 time: 0.0446866
May 28 14:27:57.785095 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27f50468-9166-4187-a5d6-df6728b3cf2a req-ca3d9140-26ca-4aee-a3b6-262aa594684e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:57.786768 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-27f50468-9166-4187-a5d6-df6728b3cf2a req-ca3d9140-26ca-4aee-a3b6-262aa594684e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0872836
May 28 14:27:57.834732 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-27f50468-9166-4187-a5d6-df6728b3cf2a req-320968fb-f5d9-49ea-9df6-698254edafc9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0408430
May 28 14:27:57.846685 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:57.865135 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9413808d-8c29-41f6-b0ab-3a202429cf23 req-92556d6f-f822-4aa7-b8c0-357e0b72e21f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 210 time: 0.0419886
May 28 14:27:59.024763 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0abc66-6c7b-4605-9a17-12d2035389f7 req-d511649a-e3bf-43b7-b8b1-baa76a425c07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:59.026967 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1e0abc66-6c7b-4605-9a17-12d2035389f7 req-d511649a-e3bf-43b7-b8b1-baa76a425c07 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0809402
May 28 14:27:59.052873 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fcf8b641-e901-42d0-998d-72b45e40e143 req-0824dcee-fc9e-42d4-844d-61e627f5436a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 210 time: 0.0804677
May 28 14:27:59.077669 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1e0abc66-6c7b-4605-9a17-12d2035389f7 req-fca3ce7e-6724-4a91-a411-815e95ee7a82 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0446420
May 28 14:27:59.177020 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-4cfc854f-711e-427a-81cd-743c454a729a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:27:59.178419 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-4cfc854f-711e-427a-81cd-743c454a729a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "GET /v2.0/networks?id=37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 200  len: 814 time: 0.1660035
May 28 14:27:59.199466 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Request body: {'port': {'device_id': 'fecfff25-834b-4f86-b9dc-0e95c9fba46d', 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f', 'admin_state_up': True, 'tenant_id': '94dc9f7ad5dd40429991c68c00e7ec6d'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:27:59.335673 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:27:59.346212 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:27:59.420436 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Made reservation on behalf of 94dc9f7ad5dd40429991c68c00e7ec6d for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:27:59.424546 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:59.602586 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Allocated IP 172.20.0.6 (37e18bf5-545d-49a2-afdf-585587a7907f/a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e/c5a95e0a-897e-42cc-bae7-653a3a321292) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:27:59.811666 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:59.938758 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:27:59.944354 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:27:59.958471 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['965a8c13-7f18-4e6d-92f2-16c7c866bcfd'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:28:00.009756 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Network 37e18bf5-545d-49a2-afdf-585587a7907f is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:28:00.013349 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:28:00.017230 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:28:00.026723 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f0ae97cb-1793-4f86-93cf-81656ebbeb58 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:00.052674 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Pushing event updated for resources: {'Port': ['ID=c5a95e0a-897e-42cc-bae7-653a3a321292,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:00.064160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.064870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.064870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.065208 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.065709 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.066284 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.066760 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.067101 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.067451 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.067825 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.068219 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.068507 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:00.089401 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:00.112512 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:00.112852 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:00.253596 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0584323
May 28 14:28:00.268783 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Request body: {'port': {'device_id': 'fecfff25-834b-4f86-b9dc-0e95c9fba46d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:00.313499 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 req-74b6b949-9c31-4d8b-a101-2a0303d80677 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:00.317009 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 36754) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:00.320723 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 req-74b6b949-9c31-4d8b-a101-2a0303d80677 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1093776
May 28 14:28:00.372709 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a2752bc3-f847-4c05-aaf7-12ac0ff59992 req-5d3500ab-400b-4f5a-be82-b142e7dbfef6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0504904
May 28 14:28:00.397093 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f95863-c39f-406a-aaeb-a83b948ac0fd req-e6700064-0ade-49a8-b44b-5552f3eaaaff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:00.397785 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-75f95863-c39f-406a-aaeb-a83b948ac0fd req-e6700064-0ade-49a8-b44b-5552f3eaaaff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:28:00.432469 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:00.503956 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:00.520981 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-75f95863-c39f-406a-aaeb-a83b948ac0fd req-e6700064-0ade-49a8-b44b-5552f3eaaaff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:28:00.522118 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-75f95863-c39f-406a-aaeb-a83b948ac0fd req-e6700064-0ade-49a8-b44b-5552f3eaaaff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 931 time: 0.3249731
May 28 14:28:00.534511 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:00.563076 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Usage tracker for resource:security_group_rule and tenant:a1031cf9755146c5afb066c328605cc0 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:00.569007 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:00.623129 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:00.656560 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-75f95863-c39f-406a-aaeb-a83b948ac0fd req-105b1bd3-1239-48af-86e2-5a7907df487e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1256466
May 28 14:28:00.850853 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:00.977443 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:00.986510 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5aa60113-80de-4da4-a0e2-5b4d1cccc454 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:01.028290 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c5a95e0a-897e-42cc-bae7-653a3a321292 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:28:01.036830 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a1031cf9755146c5afb066c328605cc0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7188625
May 28 14:28:01.039591 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 36762) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:01.043423 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:01.048007 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=870a10fd-fb54-4055-bec5-6e9a9c397a17,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:01.051485 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:01.064486 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Transition to ACTIVE for port object c5a95e0a-897e-42cc-bae7-653a3a321292 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:28:01.103535 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-69d12152-2f6f-44fd-9b15-4a87def98112 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:01.129791 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-69d12152-2f6f-44fd-9b15-4a87def98112 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:01.153219 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:01.158085 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:01.266120 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-69d12152-2f6f-44fd-9b15-4a87def98112 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:01.270994 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-3aca6d9c-448c-428d-afc4-c1a1cee80b37 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:01.283319 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d12152-2f6f-44fd-9b15-4a87def98112 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=870a10fd-fb54-4055-bec5-6e9a9c397a17,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:01.288089 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-69d12152-2f6f-44fd-9b15-4a87def98112 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:01.290973 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-69d12152-2f6f-44fd-9b15-4a87def98112 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:01.292642 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-69d12152-2f6f-44fd-9b15-4a87def98112 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/870a10fd-fb54-4055-bec5-6e9a9c397a17 HTTP/1.1" status: 204  len: 168 time: 0.2517982
May 28 14:28:01.316549 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Pushing event updated for resources: {'Port': ['ID=c5a95e0a-897e-42cc-bae7-653a3a321292,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:01.327118 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:01.393832 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Attempting to bind port c5a95e0a-897e-42cc-bae7-653a3a321292 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:28:01.394097 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Attempting to bind port c5a95e0a-897e-42cc-bae7-653a3a321292 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:28:01.394418 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Attempting to bind port c5a95e0a-897e-42cc-bae7-653a3a321292 on network 37e18bf5-545d-49a2-afdf-585587a7907f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:28:01.399639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Port c5a95e0a-897e-42cc-bae7-653a3a321292 on network 37e18bf5-545d-49a2-afdf-585587a7907f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:28:01.399639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Attempting to bind port c5a95e0a-897e-42cc-bae7-653a3a321292 on network 37e18bf5-545d-49a2-afdf-585587a7907f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:28:01.405615 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 27, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:28:01.405948 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Checking segment: {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:28:01.406322 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Bound using segment: {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:28:01.406736 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Bound port: c5a95e0a-897e-42cc-bae7-653a3a321292, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:28:01.407079 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:01.505778 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] For port c5a95e0a-897e-42cc-bae7-653a3a321292, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:28:01.509179 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] For port c5a95e0a-897e-42cc-bae7-653a3a321292, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c5a95e0a-897e-42cc-bae7-653a3a321292,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:28:01.567366 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0450d46-3582-47be-8513-01c8cce3e1db req-ff3ea7a7-a38d-4066-ab4a-cd13ab662aa4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:01.569003 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c0450d46-3582-47be-8513-01c8cce3e1db req-ff3ea7a7-a38d-4066-ab4a-cd13ab662aa4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0872993
May 28 14:28:01.569978 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:01.575114 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c4930000-e325-4893-a690-e15b1baca16b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:01.617670 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c0450d46-3582-47be-8513-01c8cce3e1db req-580a0aab-640c-4a92-92a2-7d155f20ab2c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428708
May 28 14:28:01.646075 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:01.646075 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:01.646075 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] 10.222.0.90 "PUT /v2.0/ports/c5a95e0a-897e-42cc-bae7-653a3a321292 HTTP/1.1" status: 200  len: 1093 time: 1.3766050
May 28 14:28:01.646075 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fecfff25-834b-4f86-b9dc-0e95c9fba46d', 'tag': 'c5a95e0a-897e-42cc-bae7-653a3a321292'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:01.675365 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Pushing event updated for resources: {'Port': ['ID=c5a95e0a-897e-42cc-bae7-653a3a321292,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:01.678692 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:01.691859 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fecfff25-834b-4f86-b9dc-0e95c9fba46d', 'tag': 'c5a95e0a-897e-42cc-bae7-653a3a321292', 'status': 'completed', 'code': 200}
May 28 14:28:01.824201 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-cc00de91-612e-4772-8dad-4e90971a4718 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:01.825761 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-cc00de91-612e-4772-8dad-4e90971a4718 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 1096 time: 0.1047049
May 28 14:28:01.865281 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 req-09e4ece3-82d4-49f6-8448-d1504d9c9b86 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:01.866815 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 req-09e4ece3-82d4-49f6-8448-d1504d9c9b86 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 943 time: 0.0901802
May 28 14:28:01.925267 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9ec98845-bfd8-4bac-9ed6-0f2039f010c9 req-88e14917-52bf-4031-96af-955ad1534d71 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466971
May 28 14:28:01.992641 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-569d2fd0-38fd-4955-9085-a80f68ef8552 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:01.994092 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-569d2fd0-38fd-4955-9085-a80f68ef8552 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&shared=False HTTP/1.1" status: 200  len: 915 time: 0.1535678
May 28 14:28:02.136681 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-765156ab-f83f-48f3-a195-059e9d0b43e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:02.137656 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3e441c5b-8f85-44a2-ace2-83e193f1b07a req-765156ab-f83f-48f3-a195-059e9d0b43e2 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1352839
May 28 14:28:02.264867 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-dc24b711-ef9d-4cb9-bce1-4481a8615451 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:02.266359 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-dc24b711-ef9d-4cb9-bce1-4481a8615451 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 1096 time: 0.0854084
May 28 14:28:02.343441 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-b8133cc5-8f30-4da5-8ae8-66cbdc9d80d5 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c5a95e0a-897e-42cc-bae7-653a3a321292 HTTP/1.1" status: 200  len: 217 time: 0.0623560
May 28 14:28:02.413552 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-fc7fb761-fa74-46aa-ad20-ec17b21e9c1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:02.417396 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-fc7fb761-fa74-46aa-ad20-ec17b21e9c1b service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e HTTP/1.1" status: 200  len: 854 time: 0.0640938
May 28 14:28:02.471348 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-173b0eb1-9870-462e-8c38-61c40887b373 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=37e18bf5-545d-49a2-afdf-585587a7907f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0444221
May 28 14:28:02.488870 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:02.546329 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-fb2d8271-171a-4ebb-a0bd-8c99c020bd5b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:02.628883 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-be02f3e0-4903-4c37-8c76-1174e1556bfc service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1427090
May 28 14:28:02.831476 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c831fe84-88b8-4d7f-8d7c-12553538e900 req-deec7ca7-1890-49d9-ac43-fccd7d0d4bde service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1909001
May 28 14:28:02.856386 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 req-fee5811e-e81d-4163-8d5f-034511b0d01f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:02.857907 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 req-fee5811e-e81d-4163-8d5f-034511b0d01f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1200805
May 28 14:28:02.908381 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7098d21b-5dda-4f5d-a6fe-45b821f3f1a8 req-1fa590dc-02af-4753-af36-12fb897ea8e3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0436721
May 28 14:28:03.138626 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c req-21183c8c-fab5-468d-848a-4879d87032e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:03.140140 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c req-21183c8c-fab5-468d-848a-4879d87032e6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 943 time: 0.0894492
May 28 14:28:03.191149 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0c6fbf26-8521-4af8-9e1d-7c4f5951fc7c req-1b4f8556-7aa3-4a04-b965-09346d6b6425 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451670
May 28 14:28:03.723391 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:04.106296 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 req-55492282-fd7b-4fff-94c9-0e4d9cad68e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:04.107777 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 req-55492282-fd7b-4fff-94c9-0e4d9cad68e2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0794768
May 28 14:28:04.152557 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-14aa0182-c851-4a13-b9e8-1d4ff272e1c3 req-1c32c068-467e-4434-bcc9-e19dc9ef07ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391240
May 28 14:28:04.377538 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7684504-4193-452d-8722-422e29ade708 req-e1dc6cae-0c63-4a16-b314-ba8f6c61ac66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:04.378991 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f7684504-4193-452d-8722-422e29ade708 req-e1dc6cae-0c63-4a16-b314-ba8f6c61ac66 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 943 time: 0.0824466
May 28 14:28:04.423642 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f7684504-4193-452d-8722-422e29ade708 req-646a5799-7eba-441e-9a12-d55de60b3932 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389838
May 28 14:28:05.300181 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:05.422167 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a648163b-6b01-4193-9f4a-025aeff29765 req-1420b4b6-2b70-4231-87f3-21ed7e5a3d0d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:05.423640 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a648163b-6b01-4193-9f4a-025aeff29765 req-1420b4b6-2b70-4231-87f3-21ed7e5a3d0d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1577649
May 28 14:28:05.470400 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a648163b-6b01-4193-9f4a-025aeff29765 req-a05f4faf-3c4f-4b24-b9a7-21de459408e0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0409956
May 28 14:28:05.608537 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de1019a-cc24-494f-bcf4-f7a4592fde10 req-690681f1-c448-4a02-bec4-39b2a9815848 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:05.610005 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7de1019a-cc24-494f-bcf4-f7a4592fde10 req-690681f1-c448-4a02-bec4-39b2a9815848 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 943 time: 0.0799387
May 28 14:28:05.658514 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7de1019a-cc24-494f-bcf4-f7a4592fde10 req-2ce630af-612a-49a4-a523-cbf4859d4efb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428813
May 28 14:28:05.888066 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-5c0926ec-19a1-455b-a442-acca9128c0ff tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/networks?tenant_id=a3794d25c6c34e459ce43288d19e5cbf&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0275950
May 28 14:28:06.037545 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-24675c23-a32e-41e6-ba54-537806eb0242 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:06.038888 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-24675c23-a32e-41e6-ba54-537806eb0242 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1458395
May 28 14:28:06.053771 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-7904e5e6-117a-4dde-bb7c-d3179c138afb tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/quotas/a3794d25c6c34e459ce43288d19e5cbf HTTP/1.1" status: 200  len: 375 time: 0.0088065
May 28 14:28:06.102780 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-8781c89b-12e1-4f29-a510-1c1eeda81b99 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=a3794d25c6c34e459ce43288d19e5cbf&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0442426
May 28 14:28:06.357433 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c9997479-a1e7-4604-b83e-cf0c3c5ee70e req-669f4699-e4ad-4853-a6e4-510ebcb768f1 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 210 time: 0.0426526
May 28 14:28:06.620122 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c5a95e0a-897e-42cc-bae7-653a3a321292 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:28:06.662501 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20423a12-7250-40b9-a455-afc2982f9a2a req-209cf711-fad2-4765-88c8-c7d4882dd755 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:06.663974 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-20423a12-7250-40b9-a455-afc2982f9a2a req-209cf711-fad2-4765-88c8-c7d4882dd755 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0810416
May 28 14:28:06.711792 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-20423a12-7250-40b9-a455-afc2982f9a2a req-600f88db-75e0-4fc8-b1f1-51b51bc8e572 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418754
May 28 14:28:06.754942 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c5a95e0a-897e-42cc-bae7-653a3a321292, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c5a95e0a-897e-42cc-bae7-653a3a321292,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:06.768877 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'c5a95e0a-897e-42cc-bae7-653a3a321292', 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f', 'port_id': 'c5a95e0a-897e-42cc-bae7-653a3a321292', 'mac_address': 'fa:16:3e:72:aa:23', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 851, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:28:06.833989 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:06.850930 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c5a95e0a-897e-42cc-bae7-653a3a321292 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:28:06.868179 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c5a95e0a-897e-42cc-bae7-653a3a321292, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c5a95e0a-897e-42cc-bae7-653a3a321292,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:06.877885 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79815bf6-943f-46bc-88df-8796e7518b3e req-77f32ee7-717f-4f52-9d60-cac671d572be tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:06.877885 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-79815bf6-943f-46bc-88df-8796e7518b3e req-77f32ee7-717f-4f52-9d60-cac671d572be tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 943 time: 0.0861390
May 28 14:28:06.926694 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-79815bf6-943f-46bc-88df-8796e7518b3e req-16aca423-dd67-4dc5-abf9-c72e89a54248 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459316
May 28 14:28:06.986167 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:06.988228 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:07.056108 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c5a95e0a-897e-42cc-bae7-653a3a321292,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:07.064015 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.064366 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.064704 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.065035 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.065359 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.066235 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.066235 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.066235 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.067020 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.067020 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.067265 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.067623 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:28:07.071660 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:07.505043 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3296e20e-7f55-4d8d-b42c-f616fee94e66 req-e8a87536-ae55-4232-9de7-2add1da71cee tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 210 time: 0.0449920
May 28 14:28:07.539219 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:28:07.584509 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['c5a95e0a-897e-42cc-bae7-653a3a321292'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:28:07.907408 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7993876-1f95-4644-9dcb-741b672f1dea req-01564f54-6749-4da8-a45f-8c7dc1085619 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:07.908888 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c7993876-1f95-4644-9dcb-741b672f1dea req-01564f54-6749-4da8-a45f-8c7dc1085619 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0802414
May 28 14:28:07.965003 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c7993876-1f95-4644-9dcb-741b672f1dea req-be7ba032-9f60-4199-a84e-edf2634bf64e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0504653
May 28 14:28:08.135285 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9ca0f4f-5e27-4d87-998e-1256c5428abc req-f54505e2-6490-4f58-a7d2-7d212d7901db tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:08.136846 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d9ca0f4f-5e27-4d87-998e-1256c5428abc req-f54505e2-6490-4f58-a7d2-7d212d7901db tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 944 time: 0.0961049
May 28 14:28:08.182142 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d9ca0f4f-5e27-4d87-998e-1256c5428abc req-82b494ae-85b4-4865-90e1-4de4e335dcd2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395184
May 28 14:28:08.652426 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-19f468bf-69dd-461e-97c8-a64d3302559c req-69b3ff53-7f5a-4f48-95f3-0b5555774bb7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 210 time: 0.0460205
May 28 14:28:09.015276 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-487e40d8-ec0b-4700-95fa-c432e077777b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.90 "GET /v2.0/networks?tenant_id=a3794d25c6c34e459ce43288d19e5cbf&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0265353
May 28 14:28:09.238712 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-dc9d3c29-329a-4893-8a4f-fae89d3a269e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:09.240192 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-dc9d3c29-329a-4893-8a4f-fae89d3a269e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.2174923
May 28 14:28:09.254743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 req-b5cc7fa9-1e69-4aba-9c9b-4f60ad3f5332 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:09.256206 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 req-b5cc7fa9-1e69-4aba-9c9b-4f60ad3f5332 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1569560
May 28 14:28:09.269735 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Request body: {'port': {'device_id': '1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770', 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569', 'admin_state_up': True, 'tenant_id': 'a3794d25c6c34e459ce43288d19e5cbf'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:09.406051 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430b06b9-d71f-4578-9855-22c7fb6c1193 req-1698c6e9-9f1d-43ec-8075-2381847575cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:09.408206 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-430b06b9-d71f-4578-9855-22c7fb6c1193 req-1698c6e9-9f1d-43ec-8075-2381847575cc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 944 time: 0.1072764
May 28 14:28:09.436130 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-16abbeab-9fe7-4016-9cde-e1acc46fe6a1 req-e1209b10-4b8b-4589-8877-80f11a18e000 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1722832
May 28 14:28:09.492326 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-430b06b9-d71f-4578-9855-22c7fb6c1193 req-df7c1b6e-7f48-47cf-8e62-ae4dcefe3733 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0782201
May 28 14:28:09.550687 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:09.555527 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Usage tracker for resource:port and tenant:a3794d25c6c34e459ce43288d19e5cbf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:09.558892 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:09.567817 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:09.657119 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Made reservation on behalf of a3794d25c6c34e459ce43288d19e5cbf for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:28:09.660618 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:09.675971 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:09.695976 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:09.702006 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Usage tracker for resource:security_group_rule and tenant:a3794d25c6c34e459ce43288d19e5cbf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:09.706256 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:09.713327 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:09.734955 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e758e2ee-6322-44c1-8662-7547ef02600b req-29cae52f-1ffc-4e38-bc36-00eb27490036 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:09.736498 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e758e2ee-6322-44c1-8662-7547ef02600b req-29cae52f-1ffc-4e38-bc36-00eb27490036 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.1461644
May 28 14:28:09.796366 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e758e2ee-6322-44c1-8662-7547ef02600b req-42587535-c862-47a8-a292-d331949d0ce1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528350
May 28 14:28:09.821048 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 36904) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:09.864628 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:09.943975 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-32c9534f-5407-4705-9b23-cf2df9f92cfa req-c462d337-badb-4ad9-b429-b99869a17c3c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 210 time: 0.0480173
May 28 14:28:09.957791 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:09.961214 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:10.037676 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Pushing event updated for resources: {'SecurityGroup': ['ID=08351b4a-29d7-4826-a814-d8e301c3fa2b,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:10.047415 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:10.089291 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84b3090e-6a9e-4bf0-b585-1fec5b7f2f5c tempest-TestMinimumBasicScenario-1410763667 tempest-TestMinimumBasicScenario-1410763667-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:10.093550 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-84b3090e-6a9e-4bf0-b585-1fec5b7f2f5c tempest-TestMinimumBasicScenario-1410763667 tempest-TestMinimumBasicScenario-1410763667-project-admin] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1094 time: 0.2659950
May 28 14:28:10.093737 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 36914) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:10.100571 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'floatingip': {'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'port_id': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'fixed_ip_address': '172.20.0.12'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:10.107930 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:10.112649 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Usage tracker for resource:floatingip and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:10.117117 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:10.123577 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:10.179391 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Allocated IP 192.168.233.63 (be1049d9-2ca0-4d9a-a34a-180226439569/59d0de50-0964-4064-a674-a8b8b060b9b6/2ed41bb3-bd69-4be3-a916-04232779f1d0) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:28:10.196554 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for floatingip, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:10.279610 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 req-da169921-9012-4b82-a7cc-54603846390c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:10.281177 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 req-da169921-9012-4b82-a7cc-54603846390c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 946 time: 0.1589272
May 28 14:28:10.332060 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:10.403733 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fe8e358d-2c64-4b4f-bc61-ad231ffc94d8 req-768373e2-e039-4a33-aa7c-1d9689f01d06 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0719357
May 28 14:28:10.445916 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:10.461538 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Transition to ACTIVE for port object 2ed41bb3-bd69-4be3-a916-04232779f1d0 will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:28:10.479136 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Allocated IP 172.27.3.243 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/56f11a11-b80a-4b90-a0b2-953207708e33) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:28:10.547442 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:10.554860 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-6fd7840d-4031-4a51-9edb-338d72d44edb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:10.628647 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c5a95e0a-897e-42cc-bae7-653a3a321292 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:28:10.780203 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Network be1049d9-2ca0-4d9a-a34a-180226439569 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:28:10.780891 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Pushing event updated for resources: {'Port': ['ID=2ed41bb3-bd69-4be3-a916-04232779f1d0,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:10.784008 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port c5a95e0a-897e-42cc-bae7-653a3a321292 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:28:10.784813 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:28:10.786781 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:10.788501 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:28:10.805351 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port c5a95e0a-897e-42cc-bae7-653a3a321292 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:28:10.805981 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:10.807786 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:10.858691 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a671216d-9290-4c79-a1a3-dddfc52e5f46 req-63219c99-9557-483c-a4d7-faec3e761400 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:10.866759 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:10.867408 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:10.869189 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a671216d-9290-4c79-a1a3-dddfc52e5f46 req-63219c99-9557-483c-a4d7-faec3e761400 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.2958431
May 28 14:28:10.892836 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921b4996-b7af-435e-9036-bd8fc75d6c76 req-731c163e-2171-4fed-a223-cdbe6835c595 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:10.894478 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-921b4996-b7af-435e-9036-bd8fc75d6c76 req-731c163e-2171-4fed-a223-cdbe6835c595 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 944 time: 0.2059026
May 28 14:28:10.925761 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a671216d-9290-4c79-a1a3-dddfc52e5f46 req-61caa770-edf3-4f27-abb3-d75b3e07ea2e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0555000
May 28 14:28:10.930270 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:10.935475 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4b8109f9-c165-463b-b109-eceba89e5723 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:11.004825 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-921b4996-b7af-435e-9036-bd8fc75d6c76 req-77d33031-288c-44fd-97ef-e7cf4caff78b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0873334
May 28 14:28:11.031654 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:28:11.035577 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:28:11.038803 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:11.042146 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 937 time: 1.7766163
May 28 14:28:11.050439 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:28:11.069719 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fecfff25-834b-4f86-b9dc-0e95c9fba46d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c5a95e0a-897e-42cc-bae7-653a3a321292'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:11.083940 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Request body: {'port': {'device_id': '1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:11.088392 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c5a95e0a-897e-42cc-bae7-653a3a321292, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c5a95e0a-897e-42cc-bae7-653a3a321292,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:11.128176 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fecfff25-834b-4f86-b9dc-0e95c9fba46d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c5a95e0a-897e-42cc-bae7-653a3a321292', 'code': 200}
May 28 14:28:11.148433 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'Port': ['ID=56f11a11-b80a-4b90-a0b2-953207708e33,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:11.162589 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:11.174834 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:11.177539 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:11.230557 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:11.232920 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-44dbebce-02f1-4d7f-9dd1-dd44bd0015be None None] Provisioning for port 2ed41bb3-bd69-4be3-a916-04232779f1d0 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:28:11.249972 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-44dbebce-02f1-4d7f-9dd1-dd44bd0015be None None] Provisioning complete for port 2ed41bb3-bd69-4be3-a916-04232779f1d0 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:28:11.250603 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-44dbebce-02f1-4d7f-9dd1-dd44bd0015be None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:11.309736 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b req-06501358-9574-465d-84b8-7e83f1997449 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:11.311157 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b req-06501358-9574-465d-84b8-7e83f1997449 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 935 time: 0.2045610
May 28 14:28:11.317028 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c5a95e0a-897e-42cc-bae7-653a3a321292,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:11.321956 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:11.324867 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-44dbebce-02f1-4d7f-9dd1-dd44bd0015be None None] Port 2ed41bb3-bd69-4be3-a916-04232779f1d0 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:28:11.437594 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1b0dc00d-e401-466a-8af5-c62c4a7f6e1b req-a7a45aa9-a85c-411c-bae5-5283aa185791 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1194921
May 28 14:28:11.623496 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:11.741398 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd542b9e-0890-4f1c-a775-3e9e517b0413 req-b9654f7e-bd55-434f-9764-66a5327f9d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:11.742867 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dd542b9e-0890-4f1c-a775-3e9e517b0413 req-b9654f7e-bd55-434f-9764-66a5327f9d75 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 1098 time: 0.2346139
May 28 14:28:11.755325 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2ed41bb3-bd69-4be3-a916-04232779f1d0 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:28:11.766477 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf04598-2beb-48cb-9a28-b0b883130a2c req-c1cc6e09-6655-45b5-be30-c74805a25fcd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:11.767931 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf04598-2beb-48cb-9a28-b0b883130a2c req-c1cc6e09-6655-45b5-be30-c74805a25fcd tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 946 time: 0.2093456
May 28 14:28:11.774663 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:11.784213 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:11.834518 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Transition to ACTIVE for port object 2ed41bb3-bd69-4be3-a916-04232779f1d0 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:28:11.856024 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dd542b9e-0890-4f1c-a775-3e9e517b0413 req-fe8d9005-0f2f-478b-9d3e-bb59d39e6a79 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0871570
May 28 14:28:11.860562 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf04598-2beb-48cb-9a28-b0b883130a2c req-44be3615-eb7d-404a-b633-5eb0d2fe1241 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0722623
May 28 14:28:11.911649 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:11.917183 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c6e70820-9d5a-4c84-aa2f-4c20eeea0f4d tempest-VolumesActionsTest-98700192 tempest-VolumesActionsTest-98700192-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:11.992846 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:12.064359 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:12.075655 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a22e4bcf-175d-48fb-8980-9f13e800da88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:12.136501 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Pushing event updated for resources: {'Port': ['ID=2ed41bb3-bd69-4be3-a916-04232779f1d0,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:12.179364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:12.243292 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'Port': ['ID=56f11a11-b80a-4b90-a0b2-953207708e33,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:12.247500 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:12.260578 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:12.287620 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-ef2c5b9d-8901-4ac7-b969-e4c11154bedc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:12.289081 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-ef2c5b9d-8901-4ac7-b969-e4c11154bedc service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2&tenant_id=3bbdb80ac64d4db395d276876322e7b0 HTTP/1.1" status: 200  len: 1096 time: 0.2644637
May 28 14:28:12.293508 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Attempting to bind port 2ed41bb3-bd69-4be3-a916-04232779f1d0 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:28:12.293838 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Attempting to bind port 2ed41bb3-bd69-4be3-a916-04232779f1d0 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': 'fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:28:12.294160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Attempting to bind port 2ed41bb3-bd69-4be3-a916-04232779f1d0 on network be1049d9-2ca0-4d9a-a34a-180226439569 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:28:12.300490 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Port 2ed41bb3-bd69-4be3-a916-04232779f1d0 on network be1049d9-2ca0-4d9a-a34a-180226439569 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:28:12.300811 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Attempting to bind port 2ed41bb3-bd69-4be3-a916-04232779f1d0 on network be1049d9-2ca0-4d9a-a34a-180226439569 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:28:12.308745 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 27, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:28:12.309079 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Checking segment: {'id': 'fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:28:12.309468 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Bound using segment: {'id': 'fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:28:12.309899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Bound port: 2ed41bb3-bd69-4be3-a916-04232779f1d0, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:28:12.310248 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:12.328555 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c20873-337d-4b30-ba31-387f65f9fb19 req-6a8cb54c-d195-493f-8955-e847a78d38dd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:12.333482 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-79c20873-337d-4b30-ba31-387f65f9fb19 req-6a8cb54c-d195-493f-8955-e847a78d38dd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 945 time: 0.1975102
May 28 14:28:12.371426 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d req-9c0a2002-fa43-402f-8630-9e1d962f5b40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:12.372974 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d req-9c0a2002-fa43-402f-8630-9e1d962f5b40 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.2159355
May 28 14:28:12.489588 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-79c20873-337d-4b30-ba31-387f65f9fb19 req-cd4f1b35-c4b6-458f-80c9-2679f3710fd6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1528330
May 28 14:28:12.493725 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6b66f7d7-408f-4a55-9e6b-17b70ab2558d req-c6243a62-c0ff-46c2-8712-da21038d5d15 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0677168
May 28 14:28:12.495189 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.l3_db [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Floating IP 4f96cf61-8849-454f-9454-827121621f00 associated. External IP: 172.27.3.243, port: 164fd7c8-7a57-4285-93ef-c3fdabceb8be.
May 28 14:28:12.516319 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] For port 2ed41bb3-bd69-4be3-a916-04232779f1d0, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:28:12.533294 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] For port 2ed41bb3-bd69-4be3-a916-04232779f1d0, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=2ed41bb3-bd69-4be3-a916-04232779f1d0,segment=NetworkSegment(fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc),segment_id=fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:28:12.542008 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-1122476e-a458-468a-836e-fb7f1d06586b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:12.547513 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-1122476e-a458-468a-836e-fb7f1d06586b service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1096 time: 0.1768105
May 28 14:28:12.655798 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:12.661525 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:12.842641 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:12.848044 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:12.849496 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] 10.222.0.90 "PUT /v2.0/ports/2ed41bb3-bd69-4be3-a916-04232779f1d0 HTTP/1.1" status: 200  len: 1097 time: 1.7707222
May 28 14:28:12.850038 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770', 'tag': '2ed41bb3-bd69-4be3-a916-04232779f1d0'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:12.879078 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-381b227f-e2ed-4467-84b9-34a7ede6cd73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:12.880560 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-381b227f-e2ed-4467-84b9-34a7ede6cd73 service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.3130968
May 28 14:28:12.886147 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Pushing event updated for resources: {'Port': ['ID=2ed41bb3-bd69-4be3-a916-04232779f1d0,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:12.891449 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:12.911177 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd req-577b1ab9-2f6c-4c4b-a198-57519ead98ed tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:12.912684 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd req-577b1ab9-2f6c-4c4b-a198-57519ead98ed tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.2855957
May 28 14:28:12.963937 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770', 'tag': '2ed41bb3-bd69-4be3-a916-04232779f1d0', 'status': 'completed', 'code': 200}
May 28 14:28:13.046991 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c5122a74-3cf1-4abb-b74c-2b35ea5264bd req-af54df6a-6e2e-4799-bfe4-a03040d295a4 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1244152
May 28 14:28:13.081009 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Router 68f2234d-46e9-4ac9-862b-d0d654ece63d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:28:13.129111 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-e236108c-3a86-4c12-b535-4937a9877165 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 200  len: 999 time: 0.2364247
May 28 14:28:13.189314 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42181018-6ba1-4047-ad1b-834110c441f9 req-9595ed60-1627-4b43-bf48-825ed29df6b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:13.191371 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-42181018-6ba1-4047-ad1b-834110c441f9 req-9595ed60-1627-4b43-bf48-825ed29df6b5 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=a3794d25c6c34e459ce43288d19e5cbf&device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 1100 time: 0.2204018
May 28 14:28:13.217920 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0b9ce0-b361-47e0-a305-a38488597fc9 req-5c4f1136-c9cb-4a83-9532-da60bc398172 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:13.219607 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fa0b9ce0-b361-47e0-a305-a38488597fc9 req-5c4f1136-c9cb-4a83-9532-da60bc398172 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 946 time: 0.1886401
May 28 14:28:13.248933 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-e5137186-77c7-4f28-8132-1440831140ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:13.254425 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-e5137186-77c7-4f28-8132-1440831140ec service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.1091852
May 28 14:28:13.266159 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:28:13.269642 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-42181018-6ba1-4047-ad1b-834110c441f9 req-1c35487a-c4fe-4ba1-9af8-6652d817a7a9 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=a3794d25c6c34e459ce43288d19e5cbf&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0621090
May 28 14:28:13.277372 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] Sync routers for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:28:13.288298 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:28:13.289284 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba31b73d0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:28:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:28:13.360161 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:13.425443 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 3.3306346
May 28 14:28:13.426384 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:13.432029 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 36938) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:13.438757 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1793117328', 'description': 'tempest-secgroup-smoke-1793117328 description', 'project_id': 'cf7193774c754e07a6f683666ab4addf'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:13.446059 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:13.451507 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fa0b9ce0-b361-47e0-a305-a38488597fc9 req-0106fe44-2463-4c8a-be01-3cc870b390c4 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2105200
May 28 14:28:13.459924 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:13.501325 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'status': 'completed', 'code': 200}
May 28 14:28:13.504000 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:28:13.515102 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-cd435247-e629-4f56-aeca-b16a4c22a75e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:13.516604 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-cd435247-e629-4f56-aeca-b16a4c22a75e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2491531
May 28 14:28:13.517573 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42181018-6ba1-4047-ad1b-834110c441f9 req-6f3250af-45c3-4cb0-aa90-5cde770b25be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:13.518950 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-42181018-6ba1-4047-ad1b-834110c441f9 req-6f3250af-45c3-4cb0-aa90-5cde770b25be service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2128017
May 28 14:28:13.669222 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.90', 61827) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:13.671233 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:13.709899 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:13.716510 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Usage tracker for resource:security_group_rule and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:13.719907 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:13.728925 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:13.773309 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-dad9e307-7c07-4b13-8686-4fbb437384bc tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:13.774816 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-dad9e307-7c07-4b13-8686-4fbb437384bc tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.90 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 946 time: 0.1609876
May 28 14:28:13.941067 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:13.983107 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba31b73d0>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '4f96cf61-8849-454f-9454-827121621f00', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'floating_ip_address': '172.27.3.243', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'port_id': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 517, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'mac_address': 'fa:16:3e:27:02:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:28:11Z', 'updated_at': '2021-05-28T14:28:11Z', 'revision_number': 0, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b557829-b439-4d08-8b5d-bd878143e67f', 'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'mac_address': 'fa:16:3e:db:9f:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:00Z', 'updated_at': '2021-05-28T14:26:07Z', 'revision_number': 5, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'subnets': [{'id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:28:13.987487 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] Checking router: 68f2234d-46e9-4ac9-862b-d0d654ece63d for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:28:13.991631 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-fb66223a-a892-4790-88ca-9f340ee40a39 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4150436
May 28 14:28:13.998783 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:28:13.999530 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba31b73d0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:28:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:28:14.038640 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-588db33d-3621-4ca7-86a7-2b29295b7265 req-e96f219f-3990-40c4-b53c-8ecf62cfd335 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:14.040245 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-588db33d-3621-4ca7-86a7-2b29295b7265 req-e96f219f-3990-40c4-b53c-8ecf62cfd335 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1718702
May 28 14:28:14.046477 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Deleting port 15e73ba1-bc57-49ac-bae9-9906c3fe9522 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:28:14.046825 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:14.068750 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:14.089131 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c10e34dd-16ef-413d-a5b6-7d737078753a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:14.092255 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-1269c81f-3e2d-4beb-9215-b5bbbfe9b628 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:14.093434 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-1269c81f-3e2d-4beb-9215-b5bbbfe9b628 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=cf7193774c754e07a6f683666ab4addf&device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1099 time: 0.5158103
May 28 14:28:14.101230 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-0b34354b-c869-40f3-b6fc-99721256da8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:14.102644 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-0b34354b-c869-40f3-b6fc-99721256da8e service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=a3794d25c6c34e459ce43288d19e5cbf&device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 1100 time: 0.3763931
May 28 14:28:14.139788 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfd7426-bf34-4543-b696-d10dde30085e req-1a75b305-d33f-4556-a9de-efa3fad22c6c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:14.141255 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6dfd7426-bf34-4543-b696-d10dde30085e req-1a75b305-d33f-4556-a9de-efa3fad22c6c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 945 time: 0.4712157
May 28 14:28:14.194064 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:28:14.226159 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3d863428-3f5e-4b80-a607-bbb4325e640a,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:14.244646 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:14.250440 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-588db33d-3621-4ca7-86a7-2b29295b7265 req-35aff322-f59a-4e33-b8e0-7cf092de02fc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1872489
May 28 14:28:14.277441 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] For port 15e73ba1-bc57-49ac-bae9-9906c3fe9522, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=15e73ba1-bc57-49ac-bae9-9906c3fe9522,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:14.277441 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:14.308040 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-a515b6e7-c488-444c-8268-da204ac69c84 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.63&port_id=2ed41bb3-bd69-4be3-a916-04232779f1d0 HTTP/1.1" status: 200  len: 217 time: 0.1616092
May 28 14:28:14.346163 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:14.350579 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.9164298
May 28 14:28:14.382190 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 36952) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:14.397431 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'security_group_rule': {'security_group_id': '3d863428-3f5e-4b80-a607-bbb4325e640a', 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:14.426681 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:14.449603 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6dfd7426-bf34-4543-b696-d10dde30085e req-b49cdfd9-033e-4ecd-b33b-bb805008de93 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2491510
May 28 14:28:14.454565 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling delete_port for 15e73ba1-bc57-49ac-bae9-9906c3fe9522 owned by compute:nova {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:28:14.457292 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Usage tracker for resource:security_group_rule and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:14.464913 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:14.475993 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-44c6a508-3847-4c5b-8840-4932158ac54d service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4744172
May 28 14:28:14.486407 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:14.516675 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-675af8c2-815d-4316-b5d1-40bffb107735 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:14.519011 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-675af8c2-815d-4316-b5d1-40bffb107735 service neutron] 10.222.0.90 "GET /v2.0/networks?id=780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 200  len: 915 time: 0.4126067
May 28 14:28:14.520822 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 req-dd0f365f-d1b5-4238-b8a9-c73d543ad5ee tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:14.522373 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 req-dd0f365f-d1b5-4238-b8a9-c73d543ad5ee tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.1107771
May 28 14:28:14.627962 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ea1c2fd2-ae34-4f20-ab49-1237f3f4b084 req-898d9aba-12b3-4faa-bb98-914c800e3c20 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0969639
May 28 14:28:14.654358 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba31b73d0>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '4f96cf61-8849-454f-9454-827121621f00', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'floating_ip_address': '172.27.3.243', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'port_id': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 517, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'mac_address': 'fa:16:3e:27:02:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:28:11Z', 'updated_at': '2021-05-28T14:28:11Z', 'revision_number': 0, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b557829-b439-4d08-8b5d-bd878143e67f', 'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'mac_address': 'fa:16:3e:db:9f:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:00Z', 'updated_at': '2021-05-28T14:26:07Z', 'revision_number': 5, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'subnets': [{'id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:28:14.658573 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68d6df2f-8a7c-488e-affa-b7313385e8a3 None None] The sync data for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi is: [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '4f96cf61-8849-454f-9454-827121621f00', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'floating_ip_address': '172.27.3.243', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'port_id': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 517, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'mac_address': 'fa:16:3e:27:02:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:28:11Z', 'updated_at': '2021-05-28T14:28:11Z', 'revision_number': 0, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b557829-b439-4d08-8b5d-bd878143e67f', 'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'mac_address': 'fa:16:3e:db:9f:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:00Z', 'updated_at': '2021-05-28T14:26:07Z', 'revision_number': 5, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'subnets': [{'id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:28:14.724491 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-6b39e99a-aa08-4e3f-bc36-f316ed4e7bd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:14.726015 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-6b39e99a-aa08-4e3f-bc36-f316ed4e7bd3 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=59d0de50-0964-4064-a674-a8b8b060b9b6 HTTP/1.1" status: 200  len: 843 time: 0.3991673
May 28 14:28:14.763666 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:14.771580 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:14.786451 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-453e4e3a-c79f-4b3b-9541-f0bebd80605b req-0ac82f7f-cbf1-4360-ae2a-2d824da59a57 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0712674
May 28 14:28:14.833859 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Pushing event deleted for resources: {'Port': ['ID=15e73ba1-bc57-49ac-bae9-9906c3fe9522,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:14.837863 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:14.880629 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:14.891737 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-fcea6cfe-6b4a-4365-9ab6-09307a027593 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 1000 time: 0.3562820
May 28 14:28:14.957250 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c991fa0-70b0-4fd5-a04d-e01d377f6304 None None] New status for floating IP 4f96cf61-8849-454f-9454-827121621f00: ACTIVE {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:28:15.010789 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-97be55ac-26c4-4e82-9753-e972e5c0cf21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:15.012319 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-97be55ac-26c4-4e82-9753-e972e5c0cf21 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=31bcc630-98a7-46cc-9928-64d7da56d404 HTTP/1.1" status: 200  len: 853 time: 0.1094759
May 28 14:28:15.019946 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-2d7cda7c-0987-435b-8886-583df53cd6fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:15.026938 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-2d7cda7c-0987-435b-8886-583df53cd6fb service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=be1049d9-2ca0-4d9a-a34a-180226439569&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.2308273
May 28 14:28:15.037401 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] No DVR routers for this DVR port 15e73ba1-bc57-49ac-bae9-9906c3fe9522 on host hv-cinder-79128 {{(pid=92694) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:28:15.040187 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:15.095898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:15.163572 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.90 "DELETE /v2.0/ports/15e73ba1-bc57-49ac-bae9-9906c3fe9522 HTTP/1.1" status: 204  len: 173 time: 1.3678815
May 28 14:28:15.219529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-6b409eb2-054a-4561-b92c-3932766b8f7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:15.220965 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-6b409eb2-054a-4561-b92c-3932766b8f7e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=780506d2-6c05-4b1f-af1f-a4a3d627ec86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1972468
May 28 14:28:15.269610 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:15.272033 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-50368be8-8298-4d60-938e-90d53284050f service neutron] 10.222.0.90 "GET /v2.0/networks/be1049d9-2ca0-4d9a-a34a-180226439569?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2040911
May 28 14:28:15.319766 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:15.387575 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d62cc1f7-7dbd-4bb1-b3c9-1cb288611084,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:15.396570 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:15.506799 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '031d9ce3-9559-48b6-b92f-47ac210b74be', 'name': 'network-vif-deleted', 'tag': '15e73ba1-bc57-49ac-bae9-9906c3fe9522'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:15.535852 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-b8efd95b-4d56-41b6-bc45-465c717b54c6 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3019388
May 28 14:28:15.546002 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:15.550092 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 1.1608493
May 28 14:28:15.555120 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 36986) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:15.561256 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'security_group_rule': {'security_group_id': '3d863428-3f5e-4b80-a607-bbb4325e640a', 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:15.564758 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d8c3d4e-1e82-472d-9dd6-47687d30168b req-b148d986-049d-407e-9188-828a55a719b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:15.566962 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4d8c3d4e-1e82-472d-9dd6-47687d30168b req-b148d986-049d-407e-9188-828a55a719b3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1587195
May 28 14:28:15.572043 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cbcd9882-fac4-424e-9eca-89dc5b631458 req-eda06aed-d67e-4356-87ae-856af77d0dc1 service neutron] 10.222.0.90 "GET /v2.0/networks/be1049d9-2ca0-4d9a-a34a-180226439569?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2452903
May 28 14:28:15.573579 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:15.582178 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Usage tracker for resource:security_group_rule and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:15.589455 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:15.599168 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:15.686166 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4d8c3d4e-1e82-472d-9dd6-47687d30168b req-81f8f1fc-90a1-406a-ae17-4a01f11aab20 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1059670
May 28 14:28:15.741401 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:15.785472 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '031d9ce3-9559-48b6-b92f-47ac210b74be', 'name': 'network-vif-deleted', 'tag': '15e73ba1-bc57-49ac-bae9-9906c3fe9522', 'status': 'completed', 'code': 200}
May 28 14:28:15.833491 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:15.845740 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 req-922ad1fc-fb5b-4179-93ab-b1315732a663 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:15.850755 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 req-922ad1fc-fb5b-4179-93ab-b1315732a663 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 945 time: 0.1977940
May 28 14:28:15.893332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:15.905750 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:15.924186 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7bd7b0d8-1e54-4f0e-a250-a60df2e95b22 req-cae10e38-de3d-49b1-af40-57ead33e05bd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0695746
May 28 14:28:15.932079 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fcfd4266-280a-454f-8e0f-dbe619dcf1ce,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:15.935212 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:16.001034 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77bb964a-139f-47eb-b449-1953d5c828fc req-8fb0c6d3-0c9c-4b2c-aea6-1bdedd1ab503 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:16.002623 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-77bb964a-139f-47eb-b449-1953d5c828fc req-8fb0c6d3-0c9c-4b2c-aea6-1bdedd1ab503 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.1156476
May 28 14:28:16.038104 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:16.040240 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-68256dc2-afd9-4ce8-9077-fbefafc87d91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4851375
May 28 14:28:16.044163 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 36996) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:16.052326 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'security_group_rule': {'security_group_id': '3d863428-3f5e-4b80-a607-bbb4325e640a', 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:16.060738 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:16.068538 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-77bb964a-139f-47eb-b449-1953d5c828fc req-97735262-7c29-4d86-a56c-a61104656486 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0592065
May 28 14:28:16.069638 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Usage tracker for resource:security_group_rule and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:16.073173 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:16.086758 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:16.117738 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-17de9032-b315-45ea-97c3-442c4f4ea030 req-0cf246a4-84a0-42bb-8ae0-a74f3536f043 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0657239
May 28 14:28:16.176132 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:16.264473 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:16.384102 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:16.386216 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:16.414664 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1482012d-6779-4003-b1a2-94b592ac7c54,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:16.417655 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:16.486669 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:16.491378 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5f788f00-a73a-406a-8cdb-2a5b1d5b8552 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4425972
May 28 14:28:16.491378 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 37008) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:16.497133 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'security_group_rule': {'security_group_id': '3d863428-3f5e-4b80-a607-bbb4325e640a', 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:16.503300 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:16.507631 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Usage tracker for resource:security_group_rule and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:16.511442 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:16.518263 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:16.642028 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:16.675112 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 15e73ba1-bc57-49ac-bae9-9906c3fe9522 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:28:16.713189 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 15e73ba1-bc57-49ac-bae9-9906c3fe9522 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:28:16.713634 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 15e73ba1-bc57-49ac-bae9-9906c3fe9522 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:28:16.750097 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:16.852275 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:16.863934 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0aed03f3-29e1-41c4-b338-2131bb0fdb45 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:16.896732 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5edd9787-5106-4326-a2c7-c910333fef00,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:16.901295 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:16.950262 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d74ea9-a223-4912-a6e3-d3ab6690e736 req-05751236-a44f-4052-a997-e3b2eaad0ab7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:16.952171 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-63d74ea9-a223-4912-a6e3-d3ab6690e736 req-05751236-a44f-4052-a997-e3b2eaad0ab7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1356912
May 28 14:28:17.010493 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-63d74ea9-a223-4912-a6e3-d3ab6690e736 req-77ec9b89-1409-4757-b012-507c677e894b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0523679
May 28 14:28:17.037452 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:17.038623 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-fa803c95-8e25-4816-8d61-91d7534a4451 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.5467749
May 28 14:28:17.041813 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 37018) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:17.046923 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'security_group_rule': {'security_group_id': '3d863428-3f5e-4b80-a607-bbb4325e640a', 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:17.053024 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:17.057640 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Usage tracker for resource:security_group_rule and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:17.060562 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:17.066422 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:17.163323 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.securitygroups_db [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Project cf7193774c754e07a6f683666ab4addf added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 28 14:28:17.170547 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:17.290120 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb req-da005480-928b-40e2-bea7-13744287c3a7 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Synchronizing usage tracker for tenant:1db248e02dac49bf8688658eb42ee752 on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:28:17.294539 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:17.297114 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 req-dfff95b0-233c-44ff-ae26-05475545246e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:17.300452 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 req-dfff95b0-233c-44ff-ae26-05475545246e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Synchronizing usage tracker for tenant:a3794d25c6c34e459ce43288d19e5cbf on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:28:17.517486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:17.519671 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-1eb62203-5af7-41dd-baeb-52d3c82c9537 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:17.534571 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 req-dfff95b0-233c-44ff-ae26-05475545246e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Unset dirty status for tenant:a3794d25c6c34e459ce43288d19e5cbf on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:28:17.535775 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 req-dfff95b0-233c-44ff-ae26-05475545246e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.3517187
May 28 14:28:17.542596 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb req-da005480-928b-40e2-bea7-13744287c3a7 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Unset dirty status for tenant:1db248e02dac49bf8688658eb42ee752 on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:28:17.543729 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-663f119e-7e3b-45d4-816d-6d6a5ff0dafb req-da005480-928b-40e2-bea7-13744287c3a7 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.3119383
May 28 14:28:17.553900 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb01b660-d628-4d9d-b9d2-ff69cdc3c25f,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:17.558914 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:17.589870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 req-f0b2c3c1-3cc0-4a60-a35b-a5f2edb3e54b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Synchronizing usage tracker for tenant:a3794d25c6c34e459ce43288d19e5cbf on resource:security_group {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:28:17.646648 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:17.648393 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-074f37e8-bfac-429f-a39f-916689a9a141 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.6051626
May 28 14:28:17.652365 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 37026) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:28:17.658205 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'security_group_rule': {'security_group_id': '3d863428-3f5e-4b80-a607-bbb4325e640a', 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:17.664626 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:17.669417 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Usage tracker for resource:security_group_rule and tenant:cf7193774c754e07a6f683666ab4addf is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:28:17.673880 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 req-f0b2c3c1-3cc0-4a60-a35b-a5f2edb3e54b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Unset dirty status for tenant:a3794d25c6c34e459ce43288d19e5cbf on resource:security_group {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:28:17.673880 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfebc5e5-ddc7-485d-a969-6c8f2f312715 req-f0b2c3c1-3cc0-4a60-a35b-a5f2edb3e54b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1293232
May 28 14:28:17.674158 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:28:17.680629 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:17.749751 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.securitygroups_db [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Project cf7193774c754e07a6f683666ab4addf added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 28 14:28:17.755841 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:17.874800 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:18.222957 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cab6b0-02ea-4cf4-9369-f851c7174add req-9c148dc9-8644-4c2a-aad6-7df954b0b536 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:18.228885 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-98cab6b0-02ea-4cf4-9369-f851c7174add req-9c148dc9-8644-4c2a-aad6-7df954b0b536 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0818818
May 28 14:28:18.267641 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:18.274991 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-98cab6b0-02ea-4cf4-9369-f851c7174add req-dc34ff43-345d-4c91-b728-c3b6a03e8a03 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441356
May 28 14:28:18.280053 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-75cc0772-5e52-4906-8533-244cfdf7bb13 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:18.309585 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bb2f0427-d640-407a-91fa-3dddfd6ad5c3,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:18.312466 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:18.386820 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:18.388044 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.7347374
May 28 14:28:18.513422 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-fa6b5a07-d59d-4a47-af90-b7baa12cfc12 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1793117328&fields=id&tenant_id=cf7193774c754e07a6f683666ab4addf HTTP/1.1" status: 200  len: 267 time: 0.0433669
May 28 14:28:18.601579 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-078b6651-8b1e-492d-a1a9-ea4a96fbce8d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:18.603064 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-078b6651-8b1e-492d-a1a9-ea4a96fbce8d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0838132
May 28 14:28:18.614823 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'port': {'security_groups': ['978436a2-dde3-4072-8794-d45c60dfdcd1', '3d863428-3f5e-4b80-a607-bbb4325e640a']}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:18.709152 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3e83e657-26b6-4502-9918-0054838a595d req-f92bce3b-037d-4b38-a8cd-d640c2a8bd3a tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0461090
May 28 14:28:18.768279 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:18.887157 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 req-dea959b3-85a4-41c9-ad26-df13a361cb91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:18.888639 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 req-dea959b3-85a4-41c9-ad26-df13a361cb91 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0854664
May 28 14:28:18.944122 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9ac47db4-4eba-4f36-a864-6c8a3ee37b49 req-8aa250c1-209e-41a5-a841-fa4db9a19da3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0487084
May 28 14:28:19.117760 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] For port 164fd7c8-7a57-4285-93ef-c3fdabceb8be, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:19.153440 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:19.207128 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:19.220605 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:19.223206 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['164fd7c8-7a57-4285-93ef-c3fdabceb8be'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:28:19.286293 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:19.287262 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:19.293317 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6b6012da-7c3a-407b-910e-a2392e58a257 req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "PUT /v2.0/ports/164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 982 time: 0.6830297
May 28 14:28:19.294061 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:19.345263 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'Port': ['ID=164fd7c8-7a57-4285-93ef-c3fdabceb8be,revision_number=6']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:19.379540 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'status': 'completed', 'code': 200}
May 28 14:28:19.380566 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:19.551746 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['164fd7c8-7a57-4285-93ef-c3fdabceb8be'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:28:19.599412 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b524e6-637b-4196-b211-2468ee8477e7 req-f6696904-0e88-4bf6-89bc-93c83aa6137a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:19.602945 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d0b524e6-637b-4196-b211-2468ee8477e7 req-f6696904-0e88-4bf6-89bc-93c83aa6137a tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.1480973
May 28 14:28:19.612390 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 req-6853c3b9-08b8-4716-8300-2f09b6921588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:19.615352 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 req-6853c3b9-08b8-4716-8300-2f09b6921588 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.1269343
May 28 14:28:19.649874 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-d0b524e6-637b-4196-b211-2468ee8477e7 req-3b04cc2d-5273-463f-88b6-782be0b37eec tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Synchronizing usage tracker for tenant:cf7193774c754e07a6f683666ab4addf on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:28:19.671306 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c8e0b7bc-faf4-4716-93f8-4257b73f10f2 req-4f976488-94dd-42e7-86e1-8ca8c0511b44 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0494907
May 28 14:28:19.721704 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-46ca8525-b4f0-4c19-8f87-284143cb7161 None None] Provisioning complete for port 164fd7c8-7a57-4285-93ef-c3fdabceb8be triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:28:19.722080 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-46ca8525-b4f0-4c19-8f87-284143cb7161 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:19.746851 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-d0b524e6-637b-4196-b211-2468ee8477e7 req-3b04cc2d-5273-463f-88b6-782be0b37eec tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Unset dirty status for tenant:cf7193774c754e07a6f683666ab4addf on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:28:19.748056 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d0b524e6-637b-4196-b211-2468ee8477e7 req-3b04cc2d-5273-463f-88b6-782be0b37eec tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1406634
May 28 14:28:19.902688 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-990fecd6-0016-440d-b47c-aa1c7b073a07 req-a3a049e7-7be4-455e-8fd1-89d8011ce409 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0559564
May 28 14:28:20.141912 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a346cf31-83cf-45f0-a481-8e72a4c0da7e req-408b034b-4d48-49d6-9209-3bd960eb5573 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:20.143231 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a346cf31-83cf-45f0-a481-8e72a4c0da7e req-408b034b-4d48-49d6-9209-3bd960eb5573 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0818591
May 28 14:28:20.197458 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a346cf31-83cf-45f0-a481-8e72a4c0da7e req-cb913766-9ae3-4611-a02e-f593c4604535 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0474653
May 28 14:28:20.890098 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99348937-1feb-488a-9cef-d93bfbb45fd2 req-32fd03ac-366d-4800-aa98-f8704b4ed4f1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:20.891580 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99348937-1feb-488a-9cef-d93bfbb45fd2 req-32fd03ac-366d-4800-aa98-f8704b4ed4f1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0922470
May 28 14:28:20.939471 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-99348937-1feb-488a-9cef-d93bfbb45fd2 req-b8523764-2cb4-40dc-9579-dfeb5154b820 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0420513
May 28 14:28:21.062121 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7f7638b3-8157-429e-9cf4-52fd9189dfc8 req-d22d9c92-bbf1-411d-804a-1cb32c020dee tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0438452
May 28 14:28:21.397754 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab7861ed-5524-4331-b92f-0931c175b181 req-192b45cc-48ad-405f-bcdf-6505ea17c1a7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:21.399248 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ab7861ed-5524-4331-b92f-0931c175b181 req-192b45cc-48ad-405f-bcdf-6505ea17c1a7 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0906091
May 28 14:28:21.451270 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ab7861ed-5524-4331-b92f-0931c175b181 req-2e73fc93-fa79-4a15-9864-4be89df7ceb9 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448921
May 28 14:28:22.152255 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f req-86f12560-0f01-40d3-8b13-7a9375fdc5c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:22.153786 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f req-86f12560-0f01-40d3-8b13-7a9375fdc5c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0949714
May 28 14:28:22.205312 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-39a2b1de-55ac-4c3a-933c-33fc4c3ff80f req-54189076-45e8-48aa-9b35-8100d5e4a63f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0460541
May 28 14:28:22.219317 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5f227f7-e6d8-4252-9626-44d059073d62 req-9595bf59-dad2-4cdf-9a49-9dca16ad6d50 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0486879
May 28 14:28:22.648445 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 req-5ef4d422-37dd-40cb-8aa7-1e81d5e5c7ae tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:22.649900 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 req-5ef4d422-37dd-40cb-8aa7-1e81d5e5c7ae tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0873928
May 28 14:28:22.695174 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-05d912f9-7cc4-4c34-8482-58e8ea25b3e5 req-6144f722-a507-48b0-899c-f7414b1f7786 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385866
May 28 14:28:23.390616 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-41e7ee28-6b67-4886-8486-009ff83b70af req-5497897f-0c5c-43bd-a2bd-ff7193e5a094 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0463359
May 28 14:28:23.429646 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8954c002-6d7b-430e-8639-7715d7b84d10 req-37ba7db2-1efc-4b11-8d4d-e5be4fd2d373 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:23.429646 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8954c002-6d7b-430e-8639-7715d7b84d10 req-37ba7db2-1efc-4b11-8d4d-e5be4fd2d373 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0845866
May 28 14:28:23.476718 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8954c002-6d7b-430e-8639-7715d7b84d10 req-1c1b8ab3-0e17-4604-8107-0c1f114417cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415664
May 28 14:28:23.894962 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f req-c8444934-fbf5-48bf-8ee2-eff18c296665 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:23.896630 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f req-c8444934-fbf5-48bf-8ee2-eff18c296665 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0921896
May 28 14:28:23.949375 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f7a5b805-8ad2-4e57-b155-d03c1be68b6f req-bca43302-d917-4d0e-981f-00ca033d0a5a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463772
May 28 14:28:24.556830 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6151fbc1-31cf-4e8c-8584-1a24155706ca req-4f54d150-a6a4-42c2-bd67-d78824298192 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0548949
May 28 14:28:24.696373 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 req-b93c9983-7a09-4e7a-81e2-12edb16477ab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:24.697873 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 req-b93c9983-7a09-4e7a-81e2-12edb16477ab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0988309
May 28 14:28:24.757874 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a6e2c474-070b-4ab9-9e69-af71ca8774e8 req-af76594d-ee8c-4d0e-a5ed-60f72e90df5b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0533495
May 28 14:28:25.154185 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 req-4b481247-4b31-45be-8bd5-939e69c65e15 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:25.155657 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 req-4b481247-4b31-45be-8bd5-939e69c65e15 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0950239
May 28 14:28:25.205901 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bb029d5d-7cdc-4ac9-8435-7f527fbe9b74 req-fbc2e70d-83e4-426e-b704-1cd07b632743 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443988
May 28 14:28:25.704173 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ca954c93-061d-41d7-8be4-927aa24c823c req-ecd48a00-136b-4615-8a6f-4bed77a0fe09 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0431516
May 28 14:28:25.959740 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b162441-6875-431e-b143-e1540172fede req-78ec3938-31cc-4f07-9190-38c91cb672bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:25.961214 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b162441-6875-431e-b143-e1540172fede req-78ec3938-31cc-4f07-9190-38c91cb672bb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0898817
May 28 14:28:26.009675 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b162441-6875-431e-b143-e1540172fede req-9776446d-922e-46f6-899b-3f1ae0cd6e71 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418153
May 28 14:28:26.420710 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b req-b1ba19b7-1356-480c-8524-7ed645cde8ee tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:26.420710 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b req-b1ba19b7-1356-480c-8524-7ed645cde8ee tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.1028447
May 28 14:28:26.473877 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2d5ac1ce-0d7e-4587-889e-8907cd9c708b req-5f2bdde7-6b17-483a-aeca-caa2f8506435 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475776
May 28 14:28:26.861580 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d9689862-fe2f-4871-bbbd-6e13a14ec04c req-bae7e9c9-9d0c-4c9b-9b34-bdfa35291852 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0468798
May 28 14:28:27.230190 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0947e0f-5363-48f1-9487-281d0e674621 req-c9836590-0c92-4074-aa19-ee4fd972425e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:27.231770 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a0947e0f-5363-48f1-9487-281d0e674621 req-c9836590-0c92-4074-aa19-ee4fd972425e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0965128
May 28 14:28:27.278676 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a0947e0f-5363-48f1-9487-281d0e674621 req-8eec21ee-0a4e-47a1-9acb-889f7fedac73 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403521
May 28 14:28:27.671309 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7576e40-3f42-4f63-9de8-a46154ab84b0 req-1111b9b4-c5f7-4f3a-80e7-84a4eacbbe78 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:27.672801 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b7576e40-3f42-4f63-9de8-a46154ab84b0 req-1111b9b4-c5f7-4f3a-80e7-84a4eacbbe78 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0877261
May 28 14:28:27.721906 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b7576e40-3f42-4f63-9de8-a46154ab84b0 req-9c029521-2216-40f5-95c2-33a1a6b03f89 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427873
May 28 14:28:27.826536 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:28.029171 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-40a4f1a3-63ce-4dba-aaf9-a3659287ab19 req-9c5b2d73-4e8e-43f0-a2e9-1c8edf08c259 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0558827
May 28 14:28:28.475284 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65043b52-c345-43ae-8457-7cf6e5f51d06 req-430066bd-0757-473a-9a29-16404c42f6e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:28.476825 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-65043b52-c345-43ae-8457-7cf6e5f51d06 req-430066bd-0757-473a-9a29-16404c42f6e9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0817618
May 28 14:28:28.522141 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-65043b52-c345-43ae-8457-7cf6e5f51d06 req-4583412c-472b-4095-80b0-078f7b2f6cbf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393407
May 28 14:28:28.919765 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a259753-ae03-41f6-92a7-db0c62a6bae7 req-69a35f90-90b5-4e6a-a6bc-dbda6e6c278a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:28.921645 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6a259753-ae03-41f6-92a7-db0c62a6bae7 req-69a35f90-90b5-4e6a-a6bc-dbda6e6c278a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0898724
May 28 14:28:28.966670 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6a259753-ae03-41f6-92a7-db0c62a6bae7 req-312f2d5e-dcb4-43ae-80b7-4063fe18cff3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393188
May 28 14:28:29.186880 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e6a453ec-6c5c-4b50-93d1-239c0d2ae32b req-f8d1c61b-2e0b-4ba8-9090-98d19a6c73b5 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0489924
May 28 14:28:29.733204 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4f8948-aa82-4788-a8ea-db27602f3d89 req-1f56970c-fbce-49fa-934b-d1cc9e2b8d0c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:29.734777 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ae4f8948-aa82-4788-a8ea-db27602f3d89 req-1f56970c-fbce-49fa-934b-d1cc9e2b8d0c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0915978
May 28 14:28:29.863515 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ae4f8948-aa82-4788-a8ea-db27602f3d89 req-6c84b0bf-0e99-441e-b167-cf5a11451c91 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1226466
May 28 14:28:30.046641 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-dfcfc18b-7518-4cc4-af57-dfc3c070c653 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:30.161673 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a188032-c197-45ed-8483-251170cfe6a3 req-24f54c84-ebcf-48c8-82ec-c47cffb24800 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:30.164019 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0a188032-c197-45ed-8483-251170cfe6a3 req-24f54c84-ebcf-48c8-82ec-c47cffb24800 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0846295
May 28 14:28:30.214284 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0a188032-c197-45ed-8483-251170cfe6a3 req-71232612-1f89-4cf6-9864-16b3da0b31c2 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440042
May 28 14:28:30.350835 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ae8632ee-1628-420a-b3f1-132962477a51 req-cda02a59-e11c-49b1-8ed1-b55f07793615 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0420785
May 28 14:28:31.203231 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcc0652-3cbb-4252-a00f-9a514091476f req-d5d7baa7-a255-43b7-822a-79589be1707f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:31.205255 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddcc0652-3cbb-4252-a00f-9a514091476f req-d5d7baa7-a255-43b7-822a-79589be1707f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0878525
May 28 14:28:31.254969 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddcc0652-3cbb-4252-a00f-9a514091476f req-88e037d3-8dd7-47a4-ad2a-968bf584dd34 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0437121
May 28 14:28:31.435099 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f req-b47fa3cf-e755-48d1-9cb9-20a3cf40e02a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:31.436658 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f req-b47fa3cf-e755-48d1-9cb9-20a3cf40e02a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.1010580
May 28 14:28:31.492300 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e53041f8-ef7f-4a0b-b25a-1f8fcd10a44f req-55708eb1-294d-441b-b4c2-113d4cd6c8f5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0498374
May 28 14:28:31.526749 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-90e67871-ed40-4696-b1df-a68ead8d08a0 req-ea419aa5-0739-4225-a60b-fcf59e2dcbbe tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0599658
May 28 14:28:32.488660 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f06e25aa-8968-4958-babb-200396ea1ec5 req-f324f1b5-0db0-45ea-90f4-f27fe00631ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:32.490272 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f06e25aa-8968-4958-babb-200396ea1ec5 req-f324f1b5-0db0-45ea-90f4-f27fe00631ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0977700
May 28 14:28:32.548637 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f06e25aa-8968-4958-babb-200396ea1ec5 req-88d3b4e0-2656-4708-a205-1f1d85c6ab44 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0514865
May 28 14:28:32.572935 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:32.574811 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-5f45148a-0108-4adb-970a-75af622a120d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:32.703971 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-282eb6df-a33a-40d2-a237-26d03bd92a42 req-f548cd3b-154d-427f-a16c-89489ad16789 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0469575
May 28 14:28:32.733723 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9cc6bba-94b8-4575-9d57-74a026c227cd req-6caa5229-26bc-4c7a-aabd-a04e98bbf4c6 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:32.735187 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e9cc6bba-94b8-4575-9d57-74a026c227cd req-6caa5229-26bc-4c7a-aabd-a04e98bbf4c6 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0871527
May 28 14:28:32.780218 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e9cc6bba-94b8-4575-9d57-74a026c227cd req-e4d6dd68-4ef2-4e88-ac85-486aaf8ed59a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394032
May 28 14:28:33.683120 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:33.739149 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e81a9a63-522c-430a-ab58-3c1aea89c0bd req-72b898e8-cc5b-4395-8acf-2be890ef6c53 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:33.740656 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e81a9a63-522c-430a-ab58-3c1aea89c0bd req-72b898e8-cc5b-4395-8acf-2be890ef6c53 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0827794
May 28 14:28:33.788542 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e81a9a63-522c-430a-ab58-3c1aea89c0bd req-8a6df2e4-a80a-4284-a533-f14d7f8d4506 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400963
May 28 14:28:33.862210 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a4d4707a-d8a7-4555-a919-0ddf00301995 req-c987b7ea-c477-486f-b097-37de8053322f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0533476
May 28 14:28:33.973760 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c490406-c325-45dd-b04f-42048ecff26a req-6b80c982-c684-4cf1-bbd4-245dd80f1edc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:33.975216 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1c490406-c325-45dd-b04f-42048ecff26a req-6b80c982-c684-4cf1-bbd4-245dd80f1edc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0844173
May 28 14:28:34.020458 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1c490406-c325-45dd-b04f-42048ecff26a req-b69e7328-b234-497a-8de2-4fdd67b4f894 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390165
May 28 14:28:34.976425 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069950a2-8d65-4940-a66d-485024600e33 req-1356e1a2-10e0-4311-8ddc-f248552616c4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:34.978541 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-069950a2-8d65-4940-a66d-485024600e33 req-1356e1a2-10e0-4311-8ddc-f248552616c4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0803740
May 28 14:28:35.009846 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2d0df656-8294-4b03-83b5-c141967e42da req-530762b2-1a80-4f23-8085-d625aee4ebd8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.0424211
May 28 14:28:35.028396 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-069950a2-8d65-4940-a66d-485024600e33 req-624d6bc7-b669-4239-bb92-998cf7d39d0b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441244
May 28 14:28:35.209225 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5824ed-14f7-4447-a740-b0b992e435a4 req-d950b52b-9a63-4dc5-855e-fcb291d81b2a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:35.210662 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0a5824ed-14f7-4447-a740-b0b992e435a4 req-d950b52b-9a63-4dc5-855e-fcb291d81b2a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0850630
May 28 14:28:35.259366 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0a5824ed-14f7-4447-a740-b0b992e435a4 req-c160ed86-5644-4808-aa7d-7aa2602282f3 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420253
May 28 14:28:35.311847 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:35.706184 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f3207333-5bac-4523-b4a9-ccff9a3e615d req-e2b534e0-a422-4c0a-bfa5-32f777ecf3b3 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2576470
May 28 14:28:35.734901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9619bb6d-eb61-4709-a770-546329e2abec req-43536f80-16ab-4262-a28b-a725d51bbfa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:35.736425 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9619bb6d-eb61-4709-a770-546329e2abec req-43536f80-16ab-4262-a28b-a725d51bbfa0 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1096 time: 0.1650460
May 28 14:28:35.949448 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9619bb6d-eb61-4709-a770-546329e2abec req-d0878645-2c2f-44c6-8669-5b794f8f974d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:35.950885 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9619bb6d-eb61-4709-a770-546329e2abec req-d0878645-2c2f-44c6-8669-5b794f8f974d service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.1875579
May 28 14:28:35.959784 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-4685abe6-3c19-4f2f-9dbc-74a4cc7e9ea8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:35.961099 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-4685abe6-3c19-4f2f-9dbc-74a4cc7e9ea8 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=cf7193774c754e07a6f683666ab4addf&device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1138 time: 0.1120377
May 28 14:28:36.141613 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9619bb6d-eb61-4709-a770-546329e2abec req-73379e8e-116e-4b9f-8f6f-ce2149c512cf service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 200  len: 999 time: 0.1783023
May 28 14:28:36.225791 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859a2fd9-9dc9-47f4-908d-f37071fd0325 req-81c980ce-e93e-47a1-b3e8-eb2a2062e7d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:36.227984 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-859a2fd9-9dc9-47f4-908d-f37071fd0325 req-81c980ce-e93e-47a1-b3e8-eb2a2062e7d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0830991
May 28 14:28:36.242250 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c1c7de0b-f129-4da8-9137-d884cd1fd667 req-72836cc5-63e0-471b-85db-4f4485da3405 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=031d9ce3-9559-48b6-b92f-47ac210b74be HTTP/1.1" status: 200  len: 210 time: 0.1029282
May 28 14:28:36.270059 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-8673a05d-56f2-481d-a605-4fd4cee96f74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:36.271488 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-8673a05d-56f2-481d-a605-4fd4cee96f74 service neutron] 10.222.0.90 "GET /v2.0/networks?id=780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 200  len: 915 time: 0.2560256
May 28 14:28:36.273602 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-859a2fd9-9dc9-47f4-908d-f37071fd0325 req-cece36d7-54c0-42b3-b212-d52f2d3146e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404551
May 28 14:28:36.279476 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9619bb6d-eb61-4709-a770-546329e2abec req-4e93c0c2-b5b0-48f2-863e-3d876562f19c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:36.280901 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9619bb6d-eb61-4709-a770-546329e2abec req-4e93c0c2-b5b0-48f2-863e-3d876562f19c service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.1015699
May 28 14:28:36.494813 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-1413f8a2-06d9-4e76-a8ea-28306b242d7d service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 1002 time: 0.2129538
May 28 14:28:36.567460 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9619bb6d-eb61-4709-a770-546329e2abec req-6f16963a-156c-4faf-8c25-8e7ff78c4897 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:36.568966 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9619bb6d-eb61-4709-a770-546329e2abec req-6f16963a-156c-4faf-8c25-8e7ff78c4897 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2283628
May 28 14:28:36.619863 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33703959-7c44-4da4-9599-a986861defcb req-e20e6661-430e-4849-b323-3e3eda63416f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:36.621712 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-33703959-7c44-4da4-9599-a986861defcb req-e20e6661-430e-4849-b323-3e3eda63416f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.2507930
May 28 14:28:36.626227 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-5d96a237-c9c0-4266-9a1e-0788c729c972 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:36.627695 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-5d96a237-c9c0-4266-9a1e-0788c729c972 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=31bcc630-98a7-46cc-9928-64d7da56d404 HTTP/1.1" status: 200  len: 853 time: 0.1217515
May 28 14:28:36.785408 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-33703959-7c44-4da4-9599-a986861defcb req-76e6b635-c811-473b-835e-5bfb4648065e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1566560
May 28 14:28:36.827000 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9619bb6d-eb61-4709-a770-546329e2abec req-be84e8ad-f88a-4372-9729-bc2027477151 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2484553
May 28 14:28:36.836846 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-bfa6bfb7-4a77-4733-a1e2-b6aa97f4cf8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:36.838827 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-bfa6bfb7-4a77-4733-a1e2-b6aa97f4cf8b service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=780506d2-6c05-4b1f-af1f-a4a3d627ec86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1513939
May 28 14:28:37.096570 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9619bb6d-eb61-4709-a770-546329e2abec req-23e2d284-8b28-45db-8b63-c88d07e734de service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2319643
May 28 14:28:37.102694 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-4020eb88-b350-44bf-90b5-a21a1ef92858 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2327724
May 28 14:28:37.360901 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3c98bc6c-cff2-4381-810f-d1587b0d6253 req-88837c61-49c3-4dbb-96af-afc64f396cb3 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2498090
May 28 14:28:37.508205 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67442c5f-b953-403e-b766-86d70bd269c2 req-2a485187-8855-4641-a865-5da2b85066fc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:37.510173 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-67442c5f-b953-403e-b766-86d70bd269c2 req-2a485187-8855-4641-a865-5da2b85066fc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0979381
May 28 14:28:37.556540 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-67442c5f-b953-403e-b766-86d70bd269c2 req-5e0ebacb-7dd8-411d-99c7-c877bf4977ca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396223
May 28 14:28:37.984050 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 req-ae21da81-070f-4b4b-bb07-5b4308a6ca3d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:37.985588 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 req-ae21da81-070f-4b4b-bb07-5b4308a6ca3d tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.0910168
May 28 14:28:38.032658 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8fb5efe0-a18b-4655-8dbc-42fd99443ba4 req-f9192f7a-c11e-4812-9aaa-21af6264c93e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410903
May 28 14:28:38.509689 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-0b66506b-4b64-4911-8481-0fff5c4b39fa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:38.511160 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-0b66506b-4b64-4911-8481-0fff5c4b39fa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/networks?id=37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 200  len: 814 time: 0.1554997
May 28 14:28:38.526796 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-de9035ec-e7bf-4332-a67e-cbdf523aaaec tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/quotas/94dc9f7ad5dd40429991c68c00e7ec6d HTTP/1.1" status: 200  len: 375 time: 0.0099256
May 28 14:28:38.615166 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-a6e43f60-d8d9-436d-a3a4-dfe221f6253d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0826731
May 28 14:28:38.756483 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7557870-a7ba-47cf-a3a5-6a5655611e1d req-2e986762-b5a9-4189-ad03-3f62f8fb85c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:38.756998 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-c2c7434a-711f-43bb-9cbe-061017383709 service neutron] 10.222.0.59 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1342165
May 28 14:28:38.757941 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d7557870-a7ba-47cf-a3a5-6a5655611e1d req-2e986762-b5a9-4189-ad03-3f62f8fb85c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0823374
May 28 14:28:38.810293 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d7557870-a7ba-47cf-a3a5-6a5655611e1d req-ed5fb9be-5f75-4e2b-922a-46e1c07a9b4f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0458770
May 28 14:28:38.830731 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 2ed41bb3-bd69-4be3-a916-04232779f1d0 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:28:38.920369 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-42dec9dc-5c21-44ce-bbc0-16e88718e7b6 service neutron] 10.222.0.59 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1561532
May 28 14:28:38.984105 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 2ed41bb3-bd69-4be3-a916-04232779f1d0, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=2ed41bb3-bd69-4be3-a916-04232779f1d0,segment=NetworkSegment(fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc),segment_id=fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:38.998623 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '2ed41bb3-bd69-4be3-a916-04232779f1d0', 'network_id': 'be1049d9-2ca0-4d9a-a34a-180226439569', 'port_id': '2ed41bb3-bd69-4be3-a916-04232779f1d0', 'mac_address': 'fa:16:3e:ed:9f:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 892, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59d0de50-0964-4064-a674-a8b8b060b9b6', 'ip_address': '192.168.233.63'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:28:39.065747 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:39.086825 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2ed41bb3-bd69-4be3-a916-04232779f1d0 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:28:39.116236 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 2ed41bb3-bd69-4be3-a916-04232779f1d0, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=2ed41bb3-bd69-4be3-a916-04232779f1d0,segment=NetworkSegment(fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc),segment_id=fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:39.201019 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:39.203911 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:39.225845 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-40aeea59-6a38-4192-a7dd-b5ed533668b2 req-9daa5598-0c33-4d2e-81f3-4b8e2850f9c7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 210 time: 0.0775061
May 28 14:28:39.253416 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d req-66c84f97-34de-4e21-989a-ba19738b68d0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:39.254950 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d req-66c84f97-34de-4e21-989a-ba19738b68d0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 947 time: 0.1039040
May 28 14:28:39.292671 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=2ed41bb3-bd69-4be3-a916-04232779f1d0,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:39.295874 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:39.316027 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e2ce5c02-c2f5-4cc3-bbec-90a50b7f785d req-a66fc417-7157-432d-b0de-7230350d7f0a tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513709
May 28 14:28:40.018377 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1359dc20-8d6d-4c53-b979-c2a566c336a8 req-1752a5df-9235-4a98-ae3a-537493ff87db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:40.019873 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1359dc20-8d6d-4c53-b979-c2a566c336a8 req-1752a5df-9235-4a98-ae3a-537493ff87db tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0815351
May 28 14:28:40.065242 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1359dc20-8d6d-4c53-b979-c2a566c336a8 req-b49dd6c6-aa73-43c7-86af-6e3e585701de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397499
May 28 14:28:40.386426 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-16d88889-5dba-4e33-9de0-b8ae795990aa req-337f2674-bc76-4d88-b287-84da4dc3b0fa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 210 time: 0.0441992
May 28 14:28:40.536722 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb req-1d2cef1e-f69a-407a-b676-8f2b9d20e60f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:40.538104 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb req-1d2cef1e-f69a-407a-b676-8f2b9d20e60f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 948 time: 0.1120365
May 28 14:28:40.586121 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8c8e453c-c031-4bd5-9d22-be34f0cc77cb req-58ad44cf-592d-4088-89df-3ebeda717bfc tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421779
May 28 14:28:41.265452 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 req-093ec469-71ee-4833-a8e9-6547356dadce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:41.266958 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 req-093ec469-71ee-4833-a8e9-6547356dadce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0888553
May 28 14:28:41.311880 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a74ce1ad-7413-4d40-918b-98a8821b1bf4 req-ccd1359c-9c4c-4aab-81be-2f97e60ffc0d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390978
May 28 14:28:41.537064 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b25d4ea3-5552-4b69-bd39-ed05b578b45a req-8bfca662-bf4e-44e4-a447-3304dee96c53 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 210 time: 0.0418041
May 28 14:28:41.771709 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649e73d2-4851-4e6d-9e5b-e3e4669617da req-6e43fb09-9ee5-45a5-84bb-48be727818ed tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:41.803269 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-649e73d2-4851-4e6d-9e5b-e3e4669617da req-6e43fb09-9ee5-45a5-84bb-48be727818ed tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 948 time: 0.0811112
May 28 14:28:41.823578 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-649e73d2-4851-4e6d-9e5b-e3e4669617da req-8698a749-202f-49b6-8bd2-d63a4df7dd1b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427229
May 28 14:28:42.507182 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-404092ba-b02c-4044-b271-46fee4182172 req-48138cbd-b3f6-401f-ab1f-0211e6ad17d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:42.508726 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-404092ba-b02c-4044-b271-46fee4182172 req-48138cbd-b3f6-401f-ab1f-0211e6ad17d1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0851359
May 28 14:28:42.553291 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-404092ba-b02c-4044-b271-46fee4182172 req-41459624-7798-41bc-9d64-6d84ae5fa1cb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389142
May 28 14:28:42.686431 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f9233a78-c764-4fea-b937-1f2dbac21f15 req-9eff5d8c-bb81-411d-ac09-ac1911a3d83f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 210 time: 0.0426695
May 28 14:28:43.007816 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 req-1cea59d3-f063-49f8-813c-f3636267a829 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:43.009269 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 req-1cea59d3-f063-49f8-813c-f3636267a829 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 948 time: 0.0803165
May 28 14:28:43.054198 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3f179ff5-1ccb-4a23-8cdb-cf37acff8782 req-1201019a-64b7-40b1-9bf7-897518fb6f69 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391793
May 28 14:28:43.752007 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 req-2491c7c0-5c21-422b-9f26-5c5c2832cb36 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:43.753530 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 req-2491c7c0-5c21-422b-9f26-5c5c2832cb36 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0817528
May 28 14:28:43.804018 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-91d8d8fc-bb1b-4c06-98f5-3124d87254d8 req-b59c076c-e575-4332-962c-d295bc0135f7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441766
May 28 14:28:43.841510 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-39264ad2-89d9-4ac1-8b09-f4e0b6d9b4e7 req-c316400f-2687-4279-a5f6-49a407f30797 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 210 time: 0.0468791
May 28 14:28:44.234989 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['2ed41bb3-bd69-4be3-a916-04232779f1d0'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:28:44.249122 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6de598-5f45-429b-9842-54f02f749d28 req-4372c1ae-f04b-4e80-8cf4-ba6adf728e8f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:44.249122 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2e6de598-5f45-429b-9842-54f02f749d28 req-4372c1ae-f04b-4e80-8cf4-ba6adf728e8f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 948 time: 0.0852413
May 28 14:28:44.296808 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2e6de598-5f45-429b-9842-54f02f749d28 req-ec3fc764-2710-4c48-836a-723ccfbe5bd6 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420823
May 28 14:28:44.487531 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-84d7c592-0d83-4e28-96e3-95c036a6277a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:44.488951 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-84d7c592-0d83-4e28-96e3-95c036a6277a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "GET /v2.0/networks?id=37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 200  len: 814 time: 0.1470129
May 28 14:28:44.502580 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Request body: {'port': {'device_id': 'd99f06a3-aa59-4312-820e-f3852cd77ac1', 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f', 'admin_state_up': True, 'tenant_id': '94dc9f7ad5dd40429991c68c00e7ec6d'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:44.541600 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:28:44.641540 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:44.650832 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:44.860931 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Made reservation on behalf of 94dc9f7ad5dd40429991c68c00e7ec6d for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:28:44.865149 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:45.009352 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e88a96a8-891a-49f1-8f1c-1b29c8d4cdbd req-fdca0763-e719-4e14-9e73-3437879dacc8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 210 time: 0.0441568
May 28 14:28:45.169543 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-799fe505-85e1-40d5-a5d2-0bf0c3991159 req-3f8a87c4-c795-493d-b8ec-214f23d5a791 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:45.171007 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-799fe505-85e1-40d5-a5d2-0bf0c3991159 req-3f8a87c4-c795-493d-b8ec-214f23d5a791 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.2472651
May 28 14:28:45.218471 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Allocated IP 172.20.0.13 (37e18bf5-545d-49a2-afdf-585587a7907f/a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e/827d9299-b0be-4acd-a8ae-13dd5fbf53f3) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:28:45.235945 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-799fe505-85e1-40d5-a5d2-0bf0c3991159 req-2db6a8cd-6064-4f01-83f0-80ed4566f082 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0589285
May 28 14:28:45.442030 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:45.489877 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 req-3564fc96-01df-4701-81c1-ce71a1d04818 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:45.491330 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 req-3564fc96-01df-4701-81c1-ce71a1d04818 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 948 time: 0.0860355
May 28 14:28:45.536287 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ced9e01c-6c31-44a4-9aa7-26f26a7347e1 req-b7a4367f-e144-4a24-9d7c-55f525f01017 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390332
May 28 14:28:45.591865 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:45.597681 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:45.609823 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'c5a95e0a-897e-42cc-bae7-653a3a321292'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:28:45.667259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Network 37e18bf5-545d-49a2-afdf-585587a7907f is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:28:45.670503 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:28:45.674396 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:28:45.709636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Pushing event updated for resources: {'Port': ['ID=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:45.714056 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:45.744662 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:45.745266 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:45.883438 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.3848431
May 28 14:28:46.009811 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Request body: {'port': {'device_id': 'd99f06a3-aa59-4312-820e-f3852cd77ac1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:46.171875 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:46.271999 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f2b473-cff4-48c3-90db-b9c9fce1270e req-a44760f2-d7d6-46b9-9164-ecde8339f856 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:46.272703 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-39f2b473-cff4-48c3-90db-b9c9fce1270e req-a44760f2-d7d6-46b9-9164-ecde8339f856 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:28:46.435338 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-39f2b473-cff4-48c3-90db-b9c9fce1270e req-a44760f2-d7d6-46b9-9164-ecde8339f856 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:28:46.436515 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-39f2b473-cff4-48c3-90db-b9c9fce1270e req-a44760f2-d7d6-46b9-9164-ecde8339f856 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 932 time: 0.3194716
May 28 14:28:46.437134 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e116fb-ef6e-4400-a905-bba2c79badad req-f42e1dee-7e9a-4e20-9781-c7f97a490028 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:46.438617 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e9e116fb-ef6e-4400-a905-bba2c79badad req-f42e1dee-7e9a-4e20-9781-c7f97a490028 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0835707
May 28 14:28:46.524629 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-39f2b473-cff4-48c3-90db-b9c9fce1270e req-fda74958-4950-452d-b9f2-73615a84bfaa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0814085
May 28 14:28:46.569092 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e9e116fb-ef6e-4400-a905-bba2c79badad req-ff9b6045-fd3d-46d8-9e73-8bd357ca2e42 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1243753
May 28 14:28:46.617276 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:28:46.625800 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:46.640416 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Transition to ACTIVE for port object 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:28:46.719152 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:46.724085 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:46.851103 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a343430a-5567-47bb-8ad2-c87163239694 req-47c852b7-9b61-434a-8190-0ba2857f91d0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:46.852590 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a343430a-5567-47bb-8ad2-c87163239694 req-47c852b7-9b61-434a-8190-0ba2857f91d0 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 948 time: 0.2004030
May 28 14:28:46.900562 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Pushing event updated for resources: {'Port': ['ID=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:46.909167 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:46.982570 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a343430a-5567-47bb-8ad2-c87163239694 req-2e63d923-3eb2-45c7-94d7-908b38408d0b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1230803
May 28 14:28:47.004496 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Attempting to bind port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:28:47.004824 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Attempting to bind port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:28:47.005149 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Attempting to bind port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 on network 37e18bf5-545d-49a2-afdf-585587a7907f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:28:47.009827 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 on network 37e18bf5-545d-49a2-afdf-585587a7907f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:28:47.010137 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Attempting to bind port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 on network 37e18bf5-545d-49a2-afdf-585587a7907f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:28:47.015381 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 28, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:28:47.015743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Checking segment: {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:28:47.016119 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Bound using segment: {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:28:47.016535 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Bound port: 827d9299-b0be-4acd-a8ae-13dd5fbf53f3, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:28:47.016872 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:47.105663 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] For port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:28:47.109356 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] For port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:28:47.203279 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:47.207235 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-118e7eaf-203e-4013-868d-609e7957fc7a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:47.265850 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:47.266498 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:47.268013 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] 10.222.0.90 "PUT /v2.0/ports/827d9299-b0be-4acd-a8ae-13dd5fbf53f3 HTTP/1.1" status: 200  len: 1094 time: 1.2633889
May 28 14:28:47.270818 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd99f06a3-aa59-4312-820e-f3852cd77ac1', 'tag': '827d9299-b0be-4acd-a8ae-13dd5fbf53f3'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:47.294084 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Pushing event updated for resources: {'Port': ['ID=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:47.294998 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:47.320516 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd99f06a3-aa59-4312-820e-f3852cd77ac1', 'tag': '827d9299-b0be-4acd-a8ae-13dd5fbf53f3', 'status': 'completed', 'code': 200}
May 28 14:28:47.720403 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f9ef797-dcdc-4292-b50a-3000da371a23 req-1673f617-c728-4cef-b22c-b179afbf5ce7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:47.721931 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2f9ef797-dcdc-4292-b50a-3000da371a23 req-1673f617-c728-4cef-b22c-b179afbf5ce7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 944 time: 0.0832539
May 28 14:28:47.761467 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad946536-12dd-4dd0-b804-0a4568f6ea34 req-99fa92b9-df4e-431d-a80d-56206a936243 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:47.762933 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ad946536-12dd-4dd0-b804-0a4568f6ea34 req-99fa92b9-df4e-431d-a80d-56206a936243 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 943 time: 0.0809915
May 28 14:28:47.769178 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2f9ef797-dcdc-4292-b50a-3000da371a23 req-6870402b-a7e2-43ec-a54c-41f1fa0dea93 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407619
May 28 14:28:47.809350 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ad946536-12dd-4dd0-b804-0a4568f6ea34 req-28007e78-f581-4d28-aca3-eddbad43a482 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387444
May 28 14:28:48.246897 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddc48bd-0f69-4f17-be64-2460af927f20 req-c1eb0c53-bf2f-4cf9-8166-8d8d1e02c2ef tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:48.248504 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dddc48bd-0f69-4f17-be64-2460af927f20 req-c1eb0c53-bf2f-4cf9-8166-8d8d1e02c2ef tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 948 time: 0.1621795
May 28 14:28:48.292678 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dddc48bd-0f69-4f17-be64-2460af927f20 req-e6fffd99-275a-490b-bb00-ea21c3e7589b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383756
May 28 14:28:48.380019 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:28:48.384861 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 2ed41bb3-bd69-4be3-a916-04232779f1d0 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:28:48.593997 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:48.606590 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'port_id': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'mac_address': 'fa:16:3e:f8:88:b6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 869, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:28:48.659977 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 2ed41bb3-bd69-4be3-a916-04232779f1d0 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:28:48.666984 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:48.676712 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 2ed41bb3-bd69-4be3-a916-04232779f1d0 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:28:48.677071 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:48.719818 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c2872b93-4077-4bc0-8619-140f73de2a3a {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:28:48.745690 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:48.811398 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:48.821990 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:48.827596 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:48.896805 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ed41bb3-bd69-4be3-a916-04232779f1d0'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:48.913368 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 2ed41bb3-bd69-4be3-a916-04232779f1d0, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=2ed41bb3-bd69-4be3-a916-04232779f1d0,segment=NetworkSegment(fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc),segment_id=fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:48.925538 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=9']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:48.929221 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:48.992663 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:48.998015 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:49.000978 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b621f471-c7a8-4083-91f4-90cdbee1224b req-7d380720-6841-431b-a7c1-44e1ce5484ff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:49.002692 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b621f471-c7a8-4083-91f4-90cdbee1224b req-7d380720-6841-431b-a7c1-44e1ce5484ff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 944 time: 0.1174357
May 28 14:28:49.020560 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c49c245-4d07-4f0f-a89d-6e47d6086588 req-76c84aab-dfec-4230-989d-cc6332940817 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:49.022150 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7c49c245-4d07-4f0f-a89d-6e47d6086588 req-76c84aab-dfec-4230-989d-cc6332940817 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.0941150
May 28 14:28:49.060598 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b621f471-c7a8-4083-91f4-90cdbee1224b req-c0571541-e4a8-4985-9b1f-53c2be59a9b9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0501399
May 28 14:28:49.072326 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7c49c245-4d07-4f0f-a89d-6e47d6086588 req-7a696dea-a07f-411d-93d2-5a0951acb6be tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442338
May 28 14:28:49.082281 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=2ed41bb3-bd69-4be3-a916-04232779f1d0,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:49.104510 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:49.134030 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ed41bb3-bd69-4be3-a916-04232779f1d0', 'code': 200}
May 28 14:28:49.538348 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb1d1b1-d758-4310-98f3-9511ef38e418 req-7c100830-06e2-4c46-a4c0-26da07228759 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:49.539866 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ceb1d1b1-d758-4310-98f3-9511ef38e418 req-7c100830-06e2-4c46-a4c0-26da07228759 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 949 time: 0.1416984
May 28 14:28:49.584709 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-7a4052dd-4fc4-4e2f-829e-08153ee427d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:49.586174 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-7a4052dd-4fc4-4e2f-829e-08153ee427d5 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 1097 time: 0.1278708
May 28 14:28:49.600012 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ceb1d1b1-d758-4310-98f3-9511ef38e418 req-6a86fe7a-5a17-4b48-89de-292e4e8a515c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0533459
May 28 14:28:50.280374 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b5202e-7ad2-439c-a633-b82ee57944ab req-746f22f7-0a44-44da-8973-638cec94fb47 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:50.281994 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-50b5202e-7ad2-439c-a633-b82ee57944ab req-746f22f7-0a44-44da-8973-638cec94fb47 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 944 time: 0.0987089
May 28 14:28:50.283123 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87524676-750a-49b1-950f-8564ffa9be0b req-e9fa49fd-4a77-4623-a42e-619a522af9d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:50.284689 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-87524676-750a-49b1-950f-8564ffa9be0b req-e9fa49fd-4a77-4623-a42e-619a522af9d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.0930471
May 28 14:28:50.328062 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-50b5202e-7ad2-439c-a633-b82ee57944ab req-85a1f3c3-2858-43da-ab45-ef2f577c7630 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403023
May 28 14:28:50.332633 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-87524676-750a-49b1-950f-8564ffa9be0b req-4ed98717-dce0-4c11-8ba3-733a82808b64 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421929
May 28 14:28:50.789698 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 req-e02c08ed-75b6-48bf-ab11-9f47229ce73e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:50.791025 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 req-e02c08ed-75b6-48bf-ab11-9f47229ce73e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 949 time: 0.0823765
May 28 14:28:50.835251 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-34fdf63b-16ce-4fbe-ac7d-0b199aaa2eb9 req-984f11ae-8a50-4131-a092-a064b58e29f5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384672
May 28 14:28:51.076901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-3d380feb-db59-4164-980f-d8bd08b872bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:51.078223 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-3d380feb-db59-4164-980f-d8bd08b872bc service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&shared=False HTTP/1.1" status: 200  len: 915 time: 0.1799755
May 28 14:28:51.108359 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92ce503-c324-45d9-be33-79dad0fefbb3 req-fd7dc83c-2203-4450-8dde-58cf074cc0ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:51.109783 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b92ce503-c324-45d9-be33-79dad0fefbb3 req-fd7dc83c-2203-4450-8dde-58cf074cc0ab service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 1102 time: 0.1422071
May 28 14:28:51.230561 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b92ce503-c324-45d9-be33-79dad0fefbb3 req-9e09b6ad-c7b1-4a65-9131-778e4b434185 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0697632
May 28 14:28:51.249305 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-3c7b13c4-6dc0-468a-b725-88dea172215c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:51.250666 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0017e387-706d-4a0b-a35c-4b8d51ee1b02 req-3c7b13c4-6dc0-468a-b725-88dea172215c service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1655431
May 28 14:28:51.522819 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dad625a-96d5-45b3-af60-1c729ba96f27 req-f4e7e23d-b55b-4aab-9d56-fe31a8324e0b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:51.524363 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9dad625a-96d5-45b3-af60-1c729ba96f27 req-f4e7e23d-b55b-4aab-9d56-fe31a8324e0b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 944 time: 0.0904601
May 28 14:28:51.525800 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6831763-863c-4002-b1cf-cb2b42ca340f req-f5a073f5-7afe-4476-bd04-7c7c433ed3df tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:51.527885 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a6831763-863c-4002-b1cf-cb2b42ca340f req-f5a073f5-7afe-4476-bd04-7c7c433ed3df tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.0820079
May 28 14:28:51.586274 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9dad625a-96d5-45b3-af60-1c729ba96f27 req-b406f909-245d-42dc-9a0f-0ff96f62579b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0547574
May 28 14:28:51.609229 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a6831763-863c-4002-b1cf-cb2b42ca340f req-54d7f6ab-9ed1-4919-9d5e-39385671082a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0666740
May 28 14:28:51.716301 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-a436354d-597b-4871-8d84-abfffb703017 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:51.717776 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-a436354d-597b-4871-8d84-abfffb703017 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 1097 time: 0.0711071
May 28 14:28:51.719726 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['c2872b93-4077-4bc0-8619-140f73de2a3a'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:28:51.816823 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-6d1e838b-d0e6-486a-8927-74b1f96e0656 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=827d9299-b0be-4acd-a8ae-13dd5fbf53f3 HTTP/1.1" status: 200  len: 217 time: 0.0865951
May 28 14:28:51.962238 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-db2e2176-fa92-4ca7-9370-aa748115bb66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:51.963747 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-db2e2176-fa92-4ca7-9370-aa748115bb66 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e HTTP/1.1" status: 200  len: 854 time: 0.1396735
May 28 14:28:52.017384 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 req-096a4166-f468-4b7a-b90c-1d5ffaafb395 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:52.018839 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 req-096a4166-f468-4b7a-b90c-1d5ffaafb395 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 949 time: 0.0796659
May 28 14:28:52.027885 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-63f18b44-daae-466f-99ee-8c234a4bca07 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=37e18bf5-545d-49a2-afdf-585587a7907f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0491285
May 28 14:28:52.034352 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-318cea34-958c-429f-929b-ce54be27920f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:52.035691 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-318cea34-958c-429f-929b-ce54be27920f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/networks?id=8023cc33-82ed-49b2-a8e8-69839a1ff66e HTTP/1.1" status: 200  len: 812 time: 0.2534559
May 28 14:28:52.065208 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f1eb5c73-7344-4706-96f4-f9bd7e427a91 req-0d3066a9-c3b2-46ba-84aa-0d43d5619482 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399129
May 28 14:28:52.118267 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-b7458f28-4dbb-4e8a-83ca-b27a60a1f290 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/quotas/1db248e02dac49bf8688658eb42ee752 HTTP/1.1" status: 200  len: 375 time: 0.0639231
May 28 14:28:52.174545 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-6bd60213-2875-4888-ace6-4c623a6a7063 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=1db248e02dac49bf8688658eb42ee752&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0466163
May 28 14:28:52.369280 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-41beed27-c874-4bbf-8a1f-221208c4a72f service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3325746
May 28 14:28:52.488597 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-ee067141-a36b-4f03-a0ca-b156d2760c96 service neutron] 10.222.0.59 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3017957
May 28 14:28:52.615837 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c9ee261-434e-444f-8980-f20ea1f4a7ae req-c7656e4f-87bd-4c02-b600-6aea2a1d3430 service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2274439
May 28 14:28:52.651527 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-5f32459e-b5fe-427c-8f3b-455a1d3eb06b service neutron] 10.222.0.59 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1553109
May 28 14:28:52.786443 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06db3e2a-172e-40ce-9be4-58f0aa42253c req-0ac94cd1-1e98-4ebb-afd9-2ea35fb84119 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:52.787936 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-06db3e2a-172e-40ce-9be4-58f0aa42253c req-0ac94cd1-1e98-4ebb-afd9-2ea35fb84119 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 944 time: 0.0859501
May 28 14:28:52.841199 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-06db3e2a-172e-40ce-9be4-58f0aa42253c req-546d4902-15eb-4ff0-8ca4-b89ba3af7502 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466833
May 28 14:28:52.925975 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-40f2101c-90c1-4243-a4b5-13a81b46a20f req-c6de2511-6043-4e7e-8ee7-19590dc062d9 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 210 time: 0.0442724
May 28 14:28:53.005137 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e109a040-bfe0-4f18-bef5-ca753b395ac3 req-396616f6-5feb-465d-bc0d-4362b0094fb6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:53.006697 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e109a040-bfe0-4f18-bef5-ca753b395ac3 req-396616f6-5feb-465d-bc0d-4362b0094fb6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.0903387
May 28 14:28:53.051370 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e109a040-bfe0-4f18-bef5-ca753b395ac3 req-29a3dba3-28b5-4802-bf2f-7358c9689113 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383556
May 28 14:28:53.257305 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 req-1ea82e5a-d53c-4be2-be08-89f8c9dc5949 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:53.258771 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 req-1ea82e5a-d53c-4be2-be08-89f8c9dc5949 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 949 time: 0.0859549
May 28 14:28:53.303637 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-af07ba13-cc2e-4ec0-9e21-67a36ae11e76 req-a19885ed-6bbe-4075-99a8-ce0fdac2894f tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386188
May 28 14:28:54.023914 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 req-ff4711bc-d3ff-4907-9d0d-e9e3601e8619 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:54.025378 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 req-ff4711bc-d3ff-4907-9d0d-e9e3601e8619 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 944 time: 0.0799875
May 28 14:28:54.075302 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-42925d7f-5bd4-4546-975a-fa0eb54378f1 req-2788ec9c-b56e-4ed9-9c70-cb79d037e4d7 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 210 time: 0.0439219
May 28 14:28:54.075884 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8c57df05-c9f3-49fb-85ed-f685ecd3b675 req-5107151d-7078-4064-b1fe-c2294ddfc97d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439317
May 28 14:28:54.256474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b635cd2-93cc-4246-8e44-9b7704ad592a req-8c335ea1-e9a4-408c-a0b0-a371bd0aefcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:54.258191 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8b635cd2-93cc-4246-8e44-9b7704ad592a req-8c335ea1-e9a4-408c-a0b0-a371bd0aefcc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 944 time: 0.0853202
May 28 14:28:54.305591 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8b635cd2-93cc-4246-8e44-9b7704ad592a req-86b65be8-aee8-42ba-99b0-9a30c30195e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416040
May 28 14:28:54.392366 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:28:54.463264 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port c2872b93-4077-4bc0-8619-140f73de2a3a triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:28:54.464197 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:54.499559 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-873fca3f-92fa-4e06-9ae7-92e384382dce req-697a0e01-3ab9-4608-9a78-b12f28d6ec0e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:54.501045 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-873fca3f-92fa-4e06-9ae7-92e384382dce req-697a0e01-3ab9-4608-9a78-b12f28d6ec0e tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 949 time: 0.0796649
May 28 14:28:54.552026 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-873fca3f-92fa-4e06-9ae7-92e384382dce req-d67d5d49-a8ba-4720-b6ca-c899d1370bb8 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0452964
May 28 14:28:54.581810 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:54.609371 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:54.623927 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:54.654664 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'code': 200}
May 28 14:28:54.698432 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:54.700490 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:54.766381 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=10']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:54.769423 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:55.277194 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 req-9966a3b4-3a19-4768-918b-2d82f76462a9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:55.280167 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 req-9966a3b4-3a19-4768-918b-2d82f76462a9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 944 time: 0.0893795
May 28 14:28:55.328638 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a4ccb6aa-c0e6-4f0a-a56a-c95e8ab5f540 req-d6fc033a-6ac6-4603-abeb-b046dd5aa06a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441003
May 28 14:28:55.396596 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb732260-2179-4813-94a7-e58aa900b8f2 req-219d56e8-253e-47b6-8a28-9b31a35df01b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:55.398747 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cb732260-2179-4813-94a7-e58aa900b8f2 req-219d56e8-253e-47b6-8a28-9b31a35df01b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 949 time: 0.2282677
May 28 14:28:55.431364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-16657ff8-4c02-4ec2-abfe-96bd2f55ed61 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:55.433492 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-16657ff8-4c02-4ec2-abfe-96bd2f55ed61 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.90 "GET /v2.0/networks?id=8023cc33-82ed-49b2-a8e8-69839a1ff66e HTTP/1.1" status: 200  len: 812 time: 0.2173879
May 28 14:28:55.454072 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Request body: {'port': {'device_id': 'aa156ac4-b444-4c02-a917-602aa688fba6', 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e', 'admin_state_up': True, 'tenant_id': '1db248e02dac49bf8688658eb42ee752'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:55.499212 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dbbc4843-2e71-4e9a-8f6a-edaebead3935 req-372f84c7-fce9-4820-8c12-9ffb42d33b3e tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 210 time: 0.0491281
May 28 14:28:55.529624 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cb732260-2179-4813-94a7-e58aa900b8f2 req-ce8d340c-d0db-45f6-b0d8-7caf28ae0804 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1192486
May 28 14:28:55.650489 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:28:55.668529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:28:55.693122 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efaa8f70-ed86-490d-9bfb-d4827775e227 req-0d9f05a9-3565-4e82-b593-65a014572570 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:55.694559 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-efaa8f70-ed86-490d-9bfb-d4827775e227 req-0d9f05a9-3565-4e82-b593-65a014572570 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 1099 time: 0.0880888
May 28 14:28:55.710807 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1223c015-6f90-461a-b8ae-af1f44e1452f req-256ef401-7faa-438a-bea1-5118f08191f3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:55.712297 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1223c015-6f90-461a-b8ae-af1f44e1452f req-256ef401-7faa-438a-bea1-5118f08191f3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 946 time: 0.0853090
May 28 14:28:55.738901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Made reservation on behalf of 1db248e02dac49bf8688658eb42ee752 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:28:55.742334 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:55.759924 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1223c015-6f90-461a-b8ae-af1f44e1452f req-9931d2ca-4e83-46cf-883e-6f178b020c5d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419130
May 28 14:28:55.818491 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-efaa8f70-ed86-490d-9bfb-d4827775e227 req-23b03ccb-845d-446e-bd63-4c2f498d54e7 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0974784
May 28 14:28:55.923895 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Allocated IP 172.20.0.4 (8023cc33-82ed-49b2-a8e8-69839a1ff66e/00f80d27-adb3-4b05-9355-ad0adc3a3490/59657597-74b5-4611-a1d9-144ab84f71dc) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:28:56.125750 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:56.200831 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:56.206367 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-62d64f51-651f-4075-b8cf-3f1aadab3f9b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:56.271821 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Network 8023cc33-82ed-49b2-a8e8-69839a1ff66e is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:28:56.274959 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:28:56.278548 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:28:56.312745 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Pushing event updated for resources: {'Port': ['ID=59657597-74b5-4611-a1d9-144ab84f71dc,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:56.316961 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:56.342995 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:56.343611 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:56.398988 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:28:56.427006 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.9771602
May 28 14:28:56.546023 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:56.561593 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '827d9299-b0be-4acd-a8ae-13dd5fbf53f3', 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f', 'port_id': '827d9299-b0be-4acd-a8ae-13dd5fbf53f3', 'mac_address': 'fa:16:3e:c6:5c:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 851, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:28:56.572663 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Request body: {'port': {'device_id': 'aa156ac4-b444-4c02-a917-602aa688fba6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:28:56.624532 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:56.643194 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:28:56.661873 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:56.707106 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:56.709248 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 req-ee40847f-9c69-41be-aad1-af9fd36ecfd3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:56.710736 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 req-ee40847f-9c69-41be-aad1-af9fd36ecfd3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 931 time: 0.0951619
May 28 14:28:56.723920 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d102144f-13d0-4aa5-8ef2-d10870671a2e req-4c8fc2c5-8af5-4eae-b40c-fffac57b70cb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:56.725376 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d102144f-13d0-4aa5-8ef2-d10870671a2e req-4c8fc2c5-8af5-4eae-b40c-fffac57b70cb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 944 time: 0.2870770
May 28 14:28:56.745509 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:56.747808 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:56.758082 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6dd470cc-debb-4e2d-8e19-9a0dfe715761 req-1000fb85-ee3f-4f9f-9182-3c4fd418f3c1 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404339
May 28 14:28:56.829017 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d102144f-13d0-4aa5-8ef2-d10870671a2e req-5c12a5a9-6a34-4fcf-ba94-d28a1d98910e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0954928
May 28 14:28:56.840227 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:56.852174 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:56.957570 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4206164b-296e-4b8d-a5e4-ae609d63e117 req-19c02f8d-9462-4eb0-9bfe-df4c452ff49c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:56.959109 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4206164b-296e-4b8d-a5e4-ae609d63e117 req-19c02f8d-9462-4eb0-9bfe-df4c452ff49c tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 949 time: 0.0852573
May 28 14:28:57.004377 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4206164b-296e-4b8d-a5e4-ae609d63e117 req-6213cddb-cda2-4c2c-a006-3ebc96e4247b tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389512
May 28 14:28:57.103585 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 req-da9fd676-fbd3-4b49-847a-28ce0608c894 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:57.105651 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 req-da9fd676-fbd3-4b49-847a-28ce0608c894 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 946 time: 0.1743920
May 28 14:28:57.207260 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ed32f407-e52f-4d39-b64a-d8873d4c8f64 req-58734bd8-fd3c-4b23-aec2-ac766320aaf7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0890763
May 28 14:28:57.210797 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 59657597-74b5-4611-a1d9-144ab84f71dc {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:28:57.218682 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:57.233474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Transition to ACTIVE for port object 59657597-74b5-4611-a1d9-144ab84f71dc will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:28:57.380217 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:57.384018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:57.504815 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['827d9299-b0be-4acd-a8ae-13dd5fbf53f3'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:28:57.508486 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Pushing event updated for resources: {'Port': ['ID=59657597-74b5-4611-a1d9-144ab84f71dc,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:57.535002 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:57.631993 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Attempting to bind port 59657597-74b5-4611-a1d9-144ab84f71dc on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:28:57.632323 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Attempting to bind port 59657597-74b5-4611-a1d9-144ab84f71dc by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:28:57.632696 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Attempting to bind port 59657597-74b5-4611-a1d9-144ab84f71dc on network 8023cc33-82ed-49b2-a8e8-69839a1ff66e {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:28:57.638421 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Port 59657597-74b5-4611-a1d9-144ab84f71dc on network 8023cc33-82ed-49b2-a8e8-69839a1ff66e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:28:57.638736 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Attempting to bind port 59657597-74b5-4611-a1d9-144ab84f71dc on network 8023cc33-82ed-49b2-a8e8-69839a1ff66e {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:28:57.643794 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 28, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:28:57.644128 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Checking segment: {'id': 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:28:57.644506 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Bound using segment: {'id': 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:28:57.644922 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Bound port: 59657597-74b5-4611-a1d9-144ab84f71dc, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:28:57.645261 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:57.731192 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] For port 59657597-74b5-4611-a1d9-144ab84f71dc, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:28:57.734371 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] For port 59657597-74b5-4611-a1d9-144ab84f71dc, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=59657597-74b5-4611-a1d9-144ab84f71dc,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:28:57.835590 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:57.840383 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cb86ef58-e28c-44af-8bd3-6ff8f1068fce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:57.866240 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:57.901509 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:57.901509 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:57.901807 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] 10.222.0.90 "PUT /v2.0/ports/59657597-74b5-4611-a1d9-144ab84f71dc HTTP/1.1" status: 200  len: 1093 time: 1.3381884
May 28 14:28:57.902289 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'aa156ac4-b444-4c02-a917-602aa688fba6', 'tag': '59657597-74b5-4611-a1d9-144ab84f71dc'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:28:57.923386 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Pushing event updated for resources: {'Port': ['ID=59657597-74b5-4611-a1d9-144ab84f71dc,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:57.926514 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:57.954388 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561d725b-7e76-4d8c-a624-013f864f7a1e req-25cbe7cd-d1aa-4914-b6d9-a1a7bfb14e2a tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:57.955906 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-561d725b-7e76-4d8c-a624-013f864f7a1e req-25cbe7cd-d1aa-4914-b6d9-a1a7bfb14e2a tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 943 time: 0.0921571
May 28 14:28:58.004656 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-561d725b-7e76-4d8c-a624-013f864f7a1e req-f9dd49a5-0564-4d6c-879d-3943521bf81b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427816
May 28 14:28:58.105790 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'aa156ac4-b444-4c02-a917-602aa688fba6', 'tag': '59657597-74b5-4611-a1d9-144ab84f71dc', 'status': 'completed', 'code': 200}
May 28 14:28:58.141372 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 req-0f81e225-0533-488f-baaa-6f6f55b50678 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:58.142847 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 req-0f81e225-0533-488f-baaa-6f6f55b50678 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 945 time: 0.1997986
May 28 14:28:58.156877 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-b629a5d1-e057-4cb3-8680-816a6d2a6837 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:58.158272 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-b629a5d1-e057-4cb3-8680-816a6d2a6837 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.90 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 949 time: 0.1828856
May 28 14:28:58.249465 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e38392-dd75-4cfb-bad6-401880deb3ea req-837dbb6a-4a83-4347-a292-26de06e01229 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:58.250995 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a0e38392-dd75-4cfb-bad6-401880deb3ea req-837dbb6a-4a83-4347-a292-26de06e01229 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 949 time: 0.0931025
May 28 14:28:58.271316 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ff9e2bf7-da50-4280-9f45-3d8f23d02af3 req-16583cb0-d8ab-42fd-9508-f6f14369de04 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1120825
May 28 14:28:58.275005 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cc643c91-f3ed-4437-86ea-177407753202 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:58.277015 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-cc643c91-f3ed-4437-86ea-177407753202 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=1db248e02dac49bf8688658eb42ee752&device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 1096 time: 0.2083244
May 28 14:28:58.298788 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a0e38392-dd75-4cfb-bad6-401880deb3ea req-bc4466ef-10ac-451a-a817-46ca4ab94e23 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/security-groups?id=08351b4a-29d7-4826-a814-d8e301c3fa2b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413094
May 28 14:28:58.380333 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-41b90869-625e-4d05-b915-e885758e2418 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=59657597-74b5-4611-a1d9-144ab84f71dc HTTP/1.1" status: 200  len: 217 time: 0.0750721
May 28 14:28:58.587801 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-af01494f-4b58-425d-b384-1af237181b2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:58.589324 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-af01494f-4b58-425d-b384-1af237181b2c service neutron] 10.222.0.90 "GET /v2.0/subnets?id=00f80d27-adb3-4b05-9355-ad0adc3a3490 HTTP/1.1" status: 200  len: 852 time: 0.1780913
May 28 14:28:58.639828 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Deleting port 2ed41bb3-bd69-4be3-a916-04232779f1d0 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:28:58.640162 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:58.661933 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-ce23ccc2-4bda-4cc0-9e21-9682917ce98a service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=8023cc33-82ed-49b2-a8e8-69839a1ff66e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0612743
May 28 14:28:58.722776 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e req-3f09cdee-5e6c-49f0-9c68-c1ee2fd88e98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:58.724245 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e req-3f09cdee-5e6c-49f0-9c68-c1ee2fd88e98 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 946 time: 0.3457837
May 28 14:28:58.912150 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-689d7364-bfa0-4f2c-a50e-ee40b6e3c57e req-c82c2ebb-5887-46f1-a6e7-05b257787e1f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1636701
May 28 14:28:58.938556 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] For port 2ed41bb3-bd69-4be3-a916-04232779f1d0, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=2ed41bb3-bd69-4be3-a916-04232779f1d0,segment=NetworkSegment(fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc),segment_id=fb1aaea0-7a99-4438-88c5-bf2dc2bad8dc)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:28:58.938556 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:59.077717 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Calling delete_port for 2ed41bb3-bd69-4be3-a916-04232779f1d0 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:28:59.081751 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-a54e49e0-2eb7-403c-bac5-01c24a837b2d service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3518472
May 28 14:28:59.249948 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fc46f18-303f-4f59-af9a-24f8e8fb3e93 req-d0575f71-f1e6-49f2-a528-b35d1522a835 service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1597285
May 28 14:28:59.358291 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de9dd58-8c66-48ee-88a0-6747c7a4262b req-33764e9c-b640-4a13-bb77-02b89175b25b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:59.360696 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6de9dd58-8c66-48ee-88a0-6747c7a4262b req-33764e9c-b640-4a13-bb77-02b89175b25b tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 943 time: 0.0858891
May 28 14:28:59.412702 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6de9dd58-8c66-48ee-88a0-6747c7a4262b req-b8ef328d-eb46-4574-b9a1-de063a0e3d0a tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462048
May 28 14:28:59.459314 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:59.470283 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-20a8a6fe-70ef-4a09-9ad5-fa7fe20649ba tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:28:59.530732 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Pushing event deleted for resources: {'Port': ['ID=2ed41bb3-bd69-4be3-a916-04232779f1d0,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:28:59.540467 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:28:59.552454 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0b3d6a84-54c4-45a6-9a39-7bf50f674b56 req-51a13b2c-aadc-4839-93f3-0596ac209588 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 210 time: 0.0431600
May 28 14:28:59.644192 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] No DVR routers for this DVR port 2ed41bb3-bd69-4be3-a916-04232779f1d0 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:28:59.647208 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:28:59.668283 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87c74cf-b7f8-4828-8782-39986919e33a req-39619ef5-426c-4c60-a9b2-333761c7b61b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:59.671434 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e87c74cf-b7f8-4828-8782-39986919e33a req-39619ef5-426c-4c60-a9b2-333761c7b61b service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=1db248e02dac49bf8688658eb42ee752&device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 1096 time: 0.2525067
May 28 14:28:59.677300 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 req-a96f2eb2-22c9-45dc-8af1-c8fddfe90754 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:59.678718 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 req-a96f2eb2-22c9-45dc-8af1-c8fddfe90754 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 945 time: 0.2937624
May 28 14:28:59.774676 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e118f738-acac-4c4e-8d9c-dbb7fc62a190 req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.90 "DELETE /v2.0/ports/2ed41bb3-bd69-4be3-a916-04232779f1d0 HTTP/1.1" status: 204  len: 173 time: 1.5972044
May 28 14:28:59.811874 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-01870d05-5c95-4d94-b2b6-a30a23fb9e09 req-b0adbfb4-57f1-45bb-bcf4-be9aabf9398f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1101217
May 28 14:28:59.844896 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87c74cf-b7f8-4828-8782-39986919e33a req-d3c5e6f7-9218-4c26-8216-c19a99256d35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:59.846352 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e87c74cf-b7f8-4828-8782-39986919e33a req-d3c5e6f7-9218-4c26-8216-c19a99256d35 service neutron] 10.222.0.90 "GET /v2.0/networks?id=8023cc33-82ed-49b2-a8e8-69839a1ff66e HTTP/1.1" status: 200  len: 913 time: 0.1657863
May 28 14:28:59.920113 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e87c74cf-b7f8-4828-8782-39986919e33a req-355f75ba-c538-473d-bf0a-656d46fe7a96 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=59657597-74b5-4611-a1d9-144ab84f71dc HTTP/1.1" status: 200  len: 217 time: 0.0647335
May 28 14:28:59.997179 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87c74cf-b7f8-4828-8782-39986919e33a req-12719e69-c3ab-4c6c-854b-199bc2639050 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:28:59.998930 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e87c74cf-b7f8-4828-8782-39986919e33a req-12719e69-c3ab-4c6c-854b-199bc2639050 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=00f80d27-adb3-4b05-9355-ad0adc3a3490 HTTP/1.1" status: 200  len: 852 time: 0.0674837
May 28 14:29:00.003647 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4c0ce787-5ce2-48d3-a07b-13d708b21f2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:00.053633 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e87c74cf-b7f8-4828-8782-39986919e33a req-374e41f0-00f0-4922-83df-c0ea9de4b9bb service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=8023cc33-82ed-49b2-a8e8-69839a1ff66e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0473087
May 28 14:29:00.132753 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770', 'name': 'network-vif-deleted', 'tag': '2ed41bb3-bd69-4be3-a916-04232779f1d0'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:29:00.186785 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770', 'name': 'network-vif-deleted', 'tag': '2ed41bb3-bd69-4be3-a916-04232779f1d0', 'status': 'completed', 'code': 200}
May 28 14:29:00.198901 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19428ed-659e-491d-860f-d7a554b74a78 req-2c87c12a-54ff-496a-b5d6-a3b96467f6a3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:00.200573 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e19428ed-659e-491d-860f-d7a554b74a78 req-2c87c12a-54ff-496a-b5d6-a3b96467f6a3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 946 time: 0.1721306
May 28 14:29:00.251290 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e19428ed-659e-491d-860f-d7a554b74a78 req-86f5d84c-b004-4360-ba3b-72a72c48735e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442798
May 28 14:29:00.299440 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e87c74cf-b7f8-4828-8782-39986919e33a req-d1525415-38b6-47f7-bc7d-7708374f8462 service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2370455
May 28 14:29:00.423961 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:29:00.436460 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e87c74cf-b7f8-4828-8782-39986919e33a req-7335abab-ffc7-4b89-9fd7-e94ec4f0ef86 service neutron] 10.222.0.90 "GET /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1251826
May 28 14:29:00.551124 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:29:00.556160 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:29:00.556535 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:00.615058 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad24621-b776-4ba5-be53-52ab8d812026 req-241de99c-7df8-4216-bf20-96327774dfde tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:00.615780 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-bad24621-b776-4ba5-be53-52ab8d812026 req-241de99c-7df8-4216-bf20-96327774dfde tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Synchronizing usage tracker for tenant:1db248e02dac49bf8688658eb42ee752 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:29:00.691615 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:00.694278 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-bad24621-b776-4ba5-be53-52ab8d812026 req-241de99c-7df8-4216-bf20-96327774dfde tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Unset dirty status for tenant:1db248e02dac49bf8688658eb42ee752 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:29:00.701703 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bad24621-b776-4ba5-be53-52ab8d812026 req-241de99c-7df8-4216-bf20-96327774dfde tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 943 time: 0.1789899
May 28 14:29:00.721555 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd99f06a3-aa59-4312-820e-f3852cd77ac1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '827d9299-b0be-4acd-a8ae-13dd5fbf53f3'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:29:00.727372 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1e139706-16f4-440f-bff6-9d476c2f672a req-6d7b9aa5-723c-4af5-a434-f20e09299dc5 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] 10.222.0.59 "GET /v2.0/ports?device_id=1ad1b37f-ce6b-4ddd-a9dd-6b0c83634770 HTTP/1.1" status: 200  len: 210 time: 0.0483949
May 28 14:29:00.733200 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:29:00.752604 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bad24621-b776-4ba5-be53-52ab8d812026 req-bc15fcdd-f6dd-4407-9dfd-f09ac4dea257 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455291
May 28 14:29:00.790169 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd99f06a3-aa59-4312-820e-f3852cd77ac1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '827d9299-b0be-4acd-a8ae-13dd5fbf53f3', 'code': 200}
May 28 14:29:00.795017 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:00.795891 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 2ed41bb3-bd69-4be3-a916-04232779f1d0 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:29:00.823227 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:00.872472 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 2ed41bb3-bd69-4be3-a916-04232779f1d0 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:29:00.872809 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 2ed41bb3-bd69-4be3-a916-04232779f1d0 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:29:00.899169 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:00.903048 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:01.024777 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390498f5-2546-4520-8b89-fd63964cf1da req-effc8b73-d93f-4a0f-a324-8976cb6e779e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:01.026751 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-390498f5-2546-4520-8b89-fd63964cf1da req-effc8b73-d93f-4a0f-a324-8976cb6e779e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 946 time: 0.0897787
May 28 14:29:01.072010 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-390498f5-2546-4520-8b89-fd63964cf1da req-1da0a11c-e213-489f-944c-942295679c16 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393884
May 28 14:29:01.285746 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae044f2-7fd8-4124-bba9-bfb9ce6fc603 req-93b07416-b90e-4e4a-97ae-e74a6111a9d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:01.287184 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9ae044f2-7fd8-4124-bba9-bfb9ce6fc603 req-93b07416-b90e-4e4a-97ae-e74a6111a9d4 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 1099 time: 0.0688858
May 28 14:29:01.331781 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9ae044f2-7fd8-4124-bba9-bfb9ce6fc603 req-085c030a-0ee3-42b2-bb2b-713be88efa69 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0369835
May 28 14:29:01.940940 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 req-32eddd57-571c-4e3f-a362-df3c79499977 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:01.942833 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 req-32eddd57-571c-4e3f-a362-df3c79499977 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 943 time: 0.0834062
May 28 14:29:01.989325 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6da910fb-ae34-4a1b-83c2-7c0a0558bc06 req-3d218723-3f3a-45d2-b49a-f766f6483be6 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407414
May 28 14:29:02.259762 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7df8f30-f375-4b07-9786-87864117cb38 req-506c862a-f0ca-462a-9b70-e3fff84b4997 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:02.261653 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e7df8f30-f375-4b07-9786-87864117cb38 req-506c862a-f0ca-462a-9b70-e3fff84b4997 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 946 time: 0.0819111
May 28 14:29:02.306121 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e7df8f30-f375-4b07-9786-87864117cb38 req-7db1884d-6ef4-416c-9202-b0fa023fe860 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387411
May 28 14:29:02.439283 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 59657597-74b5-4611-a1d9-144ab84f71dc details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:29:02.556262 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-609e141f-4284-4971-86a6-1b64b413d819 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:02.558241 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:02.614242 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 59657597-74b5-4611-a1d9-144ab84f71dc, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=59657597-74b5-4611-a1d9-144ab84f71dc,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:29:02.628945 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '59657597-74b5-4611-a1d9-144ab84f71dc', 'network_id': '8023cc33-82ed-49b2-a8e8-69839a1ff66e', 'port_id': '59657597-74b5-4611-a1d9-144ab84f71dc', 'mac_address': 'fa:16:3e:ee:03:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 882, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '00f80d27-adb3-4b05-9355-ad0adc3a3490', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:29:02.685899 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:02.702542 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 59657597-74b5-4611-a1d9-144ab84f71dc {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:29:02.717635 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 59657597-74b5-4611-a1d9-144ab84f71dc, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=59657597-74b5-4611-a1d9-144ab84f71dc,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:29:03.035128 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:03.037088 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:03.106746 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=59657597-74b5-4611-a1d9-144ab84f71dc,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:03.110413 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:03.193996 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673c017f-da25-474b-931f-bab49cb78d70 req-2076e9b2-6c7f-4816-a44b-0720975c26cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:03.193996 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-673c017f-da25-474b-931f-bab49cb78d70 req-2076e9b2-6c7f-4816-a44b-0720975c26cb tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 944 time: 0.0943391
May 28 14:29:03.238064 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-673c017f-da25-474b-931f-bab49cb78d70 req-83437108-6bf0-4b7b-b31f-7f811c52fc2d tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397682
May 28 14:29:03.508539 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb req-914d046a-60ff-425f-88f9-4f74160d33d9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:03.510075 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb req-914d046a-60ff-425f-88f9-4f74160d33d9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 946 time: 0.0826359
May 28 14:29:03.560932 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6acb1a0e-43a7-4c81-90ea-f87b78ea95eb req-77f2d5aa-f5f2-420f-ab3d-3f86ad801642 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432408
May 28 14:29:03.732103 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:03.842269 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['59657597-74b5-4611-a1d9-144ab84f71dc'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:29:04.448027 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aaf17b-0b43-4190-828b-0eaf63c60096 req-5306f913-aa90-4644-90c0-c7463585189a tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:04.449519 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-11aaf17b-0b43-4190-828b-0eaf63c60096 req-5306f913-aa90-4644-90c0-c7463585189a tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 944 time: 0.1042504
May 28 14:29:04.499412 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-11aaf17b-0b43-4190-828b-0eaf63c60096 req-5698a854-b1b9-47eb-82cc-4e356ce9ff93 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436144
May 28 14:29:04.744799 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb28e894-7814-4dfe-84b4-6679f2254e39 req-3c7604b9-1241-4533-8cae-7c61193c72ee tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:04.746521 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fb28e894-7814-4dfe-84b4-6679f2254e39 req-3c7604b9-1241-4533-8cae-7c61193c72ee tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 946 time: 0.0791914
May 28 14:29:04.792566 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fb28e894-7814-4dfe-84b4-6679f2254e39 req-b9bb81b9-cebd-49b1-8bf7-a160291197c9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402060
May 28 14:29:05.320697 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:05.712281 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0ccd83d-ebae-435a-9624-6636503bb689 req-4ec435b4-750a-4f4c-83bd-0d08b86513c8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:05.712750 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c0ccd83d-ebae-435a-9624-6636503bb689 req-4ec435b4-750a-4f4c-83bd-0d08b86513c8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 944 time: 0.0865848
May 28 14:29:05.768406 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c0ccd83d-ebae-435a-9624-6636503bb689 req-f7649b72-dcd0-4f3e-afd6-8a8a64716f77 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0492258
May 28 14:29:06.437714 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 59657597-74b5-4611-a1d9-144ab84f71dc up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:29:06.614286 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 59657597-74b5-4611-a1d9-144ab84f71dc completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:29:06.620400 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 59657597-74b5-4611-a1d9-144ab84f71dc triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:29:06.621164 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:06.739831 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:06.767175 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aa156ac4-b444-4c02-a917-602aa688fba6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59657597-74b5-4611-a1d9-144ab84f71dc'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:29:06.776935 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 59657597-74b5-4611-a1d9-144ab84f71dc, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=59657597-74b5-4611-a1d9-144ab84f71dc,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:29:06.812546 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aa156ac4-b444-4c02-a917-602aa688fba6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59657597-74b5-4611-a1d9-144ab84f71dc', 'code': 200}
May 28 14:29:06.848939 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:06.850770 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:06.920195 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=59657597-74b5-4611-a1d9-144ab84f71dc,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:06.931106 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:06.963910 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58faf9a9-f430-4676-ac90-21e34a001a30 req-e7df1262-5960-4ad2-97b5-ead7c1acc829 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:06.965457 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-58faf9a9-f430-4676-ac90-21e34a001a30 req-e7df1262-5960-4ad2-97b5-ead7c1acc829 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 945 time: 0.0890238
May 28 14:29:07.024952 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-58faf9a9-f430-4676-ac90-21e34a001a30 req-efab3250-2d06-480f-b9dd-0e7aaa5dfa66 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0483022
May 28 14:29:07.256741 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afac8a8f-a17b-407c-90c1-d1e82e10a363 req-e718a1c7-be30-49a1-83da-3e68d76359d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:07.258233 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-afac8a8f-a17b-407c-90c1-d1e82e10a363 req-e718a1c7-be30-49a1-83da-3e68d76359d4 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 1098 time: 0.0743809
May 28 14:29:07.306689 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-afac8a8f-a17b-407c-90c1-d1e82e10a363 req-b9dff2ac-464b-4341-838a-798a19f204af service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0347087
May 28 14:29:08.212869 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 req-1fab08d3-c524-40e0-8230-f83fe7ac1657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:08.215143 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 req-1fab08d3-c524-40e0-8230-f83fe7ac1657 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 945 time: 0.0871935
May 28 14:29:08.262616 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-48c195e2-7bd5-4812-a72c-be0c5c4500f6 req-da0de08c-a1ad-462f-a1e3-a3ec94c50ed8 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419507
May 28 14:29:08.648453 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 37734) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:29:08.800068 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-7d01aad2-7f9a-4ad8-a284-f5d6ee5c9e5d admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=a3794d25c6c34e459ce43288d19e5cbf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1505492
May 28 14:29:08.802495 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 37742) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:29:08.863356 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:08.891297 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:09.026062 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:09.029942 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc269d0f-ae9b-4067-a6bb-d0759b62e309 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:09.043964 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08351b4a-29d7-4826-a814-d8e301c3fa2b,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:09.052799 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.054098 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.054202 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.054564 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.054931 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.055288 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.055664 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.056015 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.056427 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.056813 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.057163 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.057510 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:09.060822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:09.110443 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:09.111994 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/08351b4a-29d7-4826-a814-d8e301c3fa2b HTTP/1.1" status: 204  len: 168 time: 0.3082695
May 28 14:29:09.467233 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57689df0-1365-4b6b-bd1a-3a92b4071803 req-34b67c5c-a6d5-4800-acfb-417273282673 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:09.469054 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-57689df0-1365-4b6b-bd1a-3a92b4071803 req-34b67c5c-a6d5-4800-acfb-417273282673 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 945 time: 0.0944283
May 28 14:29:09.517262 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-57689df0-1365-4b6b-bd1a-3a92b4071803 req-ac9d0f32-20c9-4037-9945-00b83de1ae0f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419717
May 28 14:29:21.540566 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:29:27.834352 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:30.019624 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-828cd06c-74cf-4af8-afed-1ff91552bf97 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:32.525811 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:32.556853 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-90b25e29-f069-4227-bcc8-30048071d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:33.814668 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:35.209051 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-95d256ca-4829-45f0-8a1b-30694d3dd340 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:35.210545 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-95d256ca-4829-45f0-8a1b-30694d3dd340 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/networks?id=37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 200  len: 814 time: 0.1472287
May 28 14:29:35.227287 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-660e1030-0f98-498d-bd25-36148b85fd6c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/quotas/94dc9f7ad5dd40429991c68c00e7ec6d HTTP/1.1" status: 200  len: 375 time: 0.0098128
May 28 14:29:35.320870 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-64acc913-eac0-476f-9610-848a6df7b35d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0894542
May 28 14:29:35.334153 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:35.457310 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-92182eb6-33a0-4a31-9b37-1e2e1fd18901 service neutron] 10.222.0.59 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1295533
May 28 14:29:35.713028 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-8098c852-dedb-4b42-98ab-0319e15856a7 service neutron] 10.222.0.59 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2497811
May 28 14:29:35.716545 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-e728696f-0b0f-40a4-adca-2991ce809418 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1640999
May 28 14:29:35.824224 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-6ca62c2a-c52e-4888-a757-a16033e96579 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:35.825713 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-6ca62c2a-c52e-4888-a757-a16033e96579 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 1098 time: 0.0738118
May 28 14:29:35.983329 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-2090d250-5607-4f7b-8be4-3b98782414b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:35.984788 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-2090d250-5607-4f7b-8be4-3b98782414b6 service neutron] 10.222.0.90 "GET /v2.0/networks?id=37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 200  len: 915 time: 0.1323621
May 28 14:29:36.000383 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4e0cf9b5-2043-47d5-a541-e1e8fd317de4 req-030554ee-ce95-43a0-a796-3940531b6f6b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 210 time: 0.0527556
May 28 14:29:36.066615 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-75b27fba-bc63-4e6e-ba92-956dbb9e63fd service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=965a8c13-7f18-4e6d-92f2-16c7c866bcfd HTTP/1.1" status: 200  len: 217 time: 0.0628271
May 28 14:29:37.148193 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fa871396-e387-4789-98d2-3c1782c89629 req-f1800644-99c4-4a2c-8430-874ff4250e34 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 210 time: 0.0449643
May 28 14:29:38.072061 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-5ac06173-c297-47ed-aad2-a88b47980355 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:38.073387 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-5ac06173-c297-47ed-aad2-a88b47980355 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e HTTP/1.1" status: 200  len: 854 time: 0.0565839
May 28 14:29:38.297302 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-172d149c-a8a8-445f-a594-04c6a2df9cfe req-cf84b678-be02-4cf2-8d94-2e8dc42278aa tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 210 time: 0.0454223
May 28 14:29:39.448634 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5982a315-741e-4d96-9d72-5802af3f9ac6 req-e31908f4-e599-48da-8aab-f43b953f6dd9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 210 time: 0.0454166
May 28 14:29:40.599578 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3d32073b-7764-4144-b95a-1a3806a438e1 req-e97381ac-65e3-4011-ad84-5075b44111b0 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 210 time: 0.0430880
May 28 14:29:41.204643 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-471cdac9-72c7-471c-a31b-66f4b82e6aa6 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=37e18bf5-545d-49a2-afdf-585587a7907f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0406554
May 28 14:29:41.344356 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-d607f7a9-1e66-46f5-a589-6ea604ec8d86 service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1316166
May 28 14:29:41.483379 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7fae6f7-9d97-49fe-afbd-f45f1309cbff req-31766dde-7e15-4b27-b5af-159ed81d8061 service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1302185
May 28 14:29:41.745080 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7f3796c9-4ed0-4959-83e2-e8a36481edcd req-947f7759-ebe7-4f1c-a583-ebc335dd5977 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 210 time: 0.0427494
May 28 14:29:42.901433 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f2c071c0-6eda-434f-b49a-498e38335535 req-42801f55-39d2-46db-b23f-061f741370cd tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 210 time: 0.0457389
May 28 14:29:43.095369 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-9de2130b-7cfe-4a11-8450-42f0272846ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:43.096806 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-9de2130b-7cfe-4a11-8450-42f0272846ad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "GET /v2.0/networks?id=37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 200  len: 814 time: 0.1411991
May 28 14:29:43.113933 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Request body: {'port': {'device_id': '9a7b74cb-2311-48b6-b58b-13c358c2c0bb', 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f', 'admin_state_up': True, 'tenant_id': '94dc9f7ad5dd40429991c68c00e7ec6d'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:29:43.250612 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:29:43.260615 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:29:43.405788 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Made reservation on behalf of 94dc9f7ad5dd40429991c68c00e7ec6d for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:29:43.409909 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:43.575521 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Allocated IP 172.20.0.5 (37e18bf5-545d-49a2-afdf-585587a7907f/a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e/cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:29:43.853166 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:43.957719 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:43.963534 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9f846cd9-aab0-4342-9a21-5e3bd985e11f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:43.971263 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'c5a95e0a-897e-42cc-bae7-653a3a321292', '827d9299-b0be-4acd-a8ae-13dd5fbf53f3'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:29:44.078874 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Network 37e18bf5-545d-49a2-afdf-585587a7907f is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:29:44.088841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:29:44.095680 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:29:44.124122 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Pushing event updated for resources: {'Port': ['ID=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:44.131641 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:44.172489 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:44.173097 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:44.198210 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 req-aaa5456c-f916-47dc-86d1-34c32dff0966 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:44.199690 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 req-aaa5456c-f916-47dc-86d1-34c32dff0966 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 931 time: 0.1869206
May 28 14:29:44.246118 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7a26e68a-bee1-4c2b-af50-5c3bd15f87d8 req-fd09b5a5-73e8-4e40-b754-1513ff849d49 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396891
May 28 14:29:44.326472 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2161369
May 28 14:29:44.351996 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Request body: {'port': {'device_id': '9a7b74cb-2311-48b6-b58b-13c358c2c0bb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:29:44.462922 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:44.800761 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:29:44.807827 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:44.822110 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Transition to ACTIVE for port object cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:29:44.911067 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:44.915617 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:45.067198 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Pushing event updated for resources: {'Port': ['ID=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:45.073886 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:45.143629 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Attempting to bind port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:29:45.144248 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Attempting to bind port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:29:45.144248 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Attempting to bind port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af on network 37e18bf5-545d-49a2-afdf-585587a7907f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:29:45.149106 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af on network 37e18bf5-545d-49a2-afdf-585587a7907f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:29:45.149433 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Attempting to bind port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af on network 37e18bf5-545d-49a2-afdf-585587a7907f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:29:45.154928 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 29, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:29:45.155303 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Checking segment: {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:29:45.155729 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Bound using segment: {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:29:45.156155 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Bound port: cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f9da76d7-4098-4417-923d-48d74a246b67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:29:45.156526 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:45.242854 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] For port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:29:45.245786 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] For port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:29:45.323100 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:45.328616 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ae95a6e8-617d-4dc0-8e4e-6db7dcb98339 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:45.388129 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:45.388723 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:45.390055 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] 10.222.0.90 "PUT /v2.0/ports/cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af HTTP/1.1" status: 200  len: 1093 time: 1.0431986
May 28 14:29:45.391114 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9a7b74cb-2311-48b6-b58b-13c358c2c0bb', 'tag': 'cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:29:45.410622 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Pushing event updated for resources: {'Port': ['ID=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:45.421376 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:45.439085 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab709e5-5b31-474c-b87d-22ce23f5b837 req-9c1f6a31-cd4b-45bc-a1a3-38f3b9c9726e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:45.441399 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2ab709e5-5b31-474c-b87d-22ce23f5b837 req-9c1f6a31-cd4b-45bc-a1a3-38f3b9c9726e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 943 time: 0.0902674
May 28 14:29:45.450082 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9a7b74cb-2311-48b6-b58b-13c358c2c0bb', 'tag': 'cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af', 'status': 'completed', 'code': 200}
May 28 14:29:45.489628 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2ab709e5-5b31-474c-b87d-22ce23f5b837 req-9cba4540-3bf4-4edb-b4e5-f5a6e53d26e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413978
May 28 14:29:45.554221 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-6160b0f5-23e7-46a5-a0aa-03cb9672dff1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:45.555719 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-6160b0f5-23e7-46a5-a0aa-03cb9672dff1 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 1096 time: 0.0725005
May 28 14:29:45.708942 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-2f34badd-5b31-4643-bea3-bbf3bd0d287c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:45.710361 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-2f34badd-5b31-4643-bea3-bbf3bd0d287c service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&shared=False HTTP/1.1" status: 200  len: 915 time: 0.1352203
May 28 14:29:45.849085 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-46212cbd-6490-4adb-ae75-ab945855577a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:45.852032 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cd904025-d05c-4751-adeb-89658d1e5c65 req-46212cbd-6490-4adb-ae75-ab945855577a service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1317525
May 28 14:29:45.970524 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-c56bcb00-8a05-4301-aa0a-456fa581470e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:45.971954 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-c56bcb00-8a05-4301-aa0a-456fa581470e service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 1096 time: 0.0755076
May 28 14:29:46.112111 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-abf86e45-9196-4b78-a5f9-a4671db38a42 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af HTTP/1.1" status: 200  len: 217 time: 0.1310911
May 28 14:29:46.178758 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-e36cc8e3-1e95-460b-925a-dbadf3ed7bef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:46.180463 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-e36cc8e3-1e95-460b-925a-dbadf3ed7bef service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e HTTP/1.1" status: 200  len: 854 time: 0.0583317
May 28 14:29:46.232768 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-e5638ae0-ca7b-433e-a640-79dece939153 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=37e18bf5-545d-49a2-afdf-585587a7907f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0407000
May 28 14:29:46.373333 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-b7c781b5-8961-4fec-896b-d5d6f8d38c5f service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1318297
May 28 14:29:46.519591 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1059deab-8594-4ad1-8cad-bc2ea4f8807a req-71cb3305-6c6d-4e98-9137-085cb50aaeab service neutron] 10.222.0.90 "GET /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1327786
May 28 14:29:46.684712 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9073622c-eba7-4bdd-ae45-6e95ab77aadd req-35a7a48b-3b1b-484e-b923-c90db03c3428 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:46.686556 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9073622c-eba7-4bdd-ae45-6e95ab77aadd req-35a7a48b-3b1b-484e-b923-c90db03c3428 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 943 time: 0.0869029
May 28 14:29:46.729897 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9073622c-eba7-4bdd-ae45-6e95ab77aadd req-97d8b988-7143-4a21-86de-86e6492a9735 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0374210
May 28 14:29:47.911716 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5b8e1f-ea70-4320-8669-964d0778be23 req-8e4b7ef4-e063-4883-a7c7-a2a4a6b0c67e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:47.913139 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7e5b8e1f-ea70-4320-8669-964d0778be23 req-8e4b7ef4-e063-4883-a7c7-a2a4a6b0c67e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 943 time: 0.0776441
May 28 14:29:47.957846 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7e5b8e1f-ea70-4320-8669-964d0778be23 req-88bbf4f7-05ed-451b-8488-d2349efd860f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390444
May 28 14:29:49.146197 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7527d55b-1d97-4bc4-b261-17b5ce24e33a req-7ca46396-3e02-4e42-b6d6-c89180ff1240 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:49.146884 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-7527d55b-1d97-4bc4-b261-17b5ce24e33a req-7ca46396-3e02-4e42-b6d6-c89180ff1240 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:29:49.208313 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-7527d55b-1d97-4bc4-b261-17b5ce24e33a req-7ca46396-3e02-4e42-b6d6-c89180ff1240 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:29:49.209464 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7527d55b-1d97-4bc4-b261-17b5ce24e33a req-7ca46396-3e02-4e42-b6d6-c89180ff1240 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 943 time: 0.1464553
May 28 14:29:49.256099 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7527d55b-1d97-4bc4-b261-17b5ce24e33a req-d5d77b0b-7f55-4ce6-a1ea-0b9a776ecbbc tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408053
May 28 14:29:49.717839 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af971194-5cc2-48b3-97d7-ae485ba15311 req-4a97f3fd-9eeb-464d-9a10-27de1478dd85 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:49.719297 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-af971194-5cc2-48b3-97d7-ae485ba15311 req-4a97f3fd-9eeb-464d-9a10-27de1478dd85 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 945 time: 0.0789666
May 28 14:29:49.762932 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-af971194-5cc2-48b3-97d7-ae485ba15311 req-1cd48b80-147c-4386-8663-26d978ae6476 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0379689
May 28 14:29:50.444197 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ad1846-89c6-4c61-a17c-da9502b28c66 req-1a9e2447-cf8c-483e-bc34-6909c846f654 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:50.445631 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-63ad1846-89c6-4c61-a17c-da9502b28c66 req-1a9e2447-cf8c-483e-bc34-6909c846f654 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 943 time: 0.0831940
May 28 14:29:50.489074 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-63ad1846-89c6-4c61-a17c-da9502b28c66 req-9e2fa5ec-a97c-4dc2-9255-9c115431e2f9 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377421
May 28 14:29:50.950471 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 req-96ced291-30db-40d2-8db1-b54b62655279 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:50.951912 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 req-96ced291-30db-40d2-8db1-b54b62655279 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 945 time: 0.0820658
May 28 14:29:50.995698 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-19b2a60b-dd94-4551-8732-d6cc50ef2a26 req-f49b71fa-50dd-4d2f-b01f-eed5635b909f tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381963
May 28 14:29:51.670620 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-368f6263-7b5a-4346-92cd-9e5b1ba47673 req-2042cccb-04e5-4758-af74-57e144d2a102 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:51.672210 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-368f6263-7b5a-4346-92cd-9e5b1ba47673 req-2042cccb-04e5-4758-af74-57e144d2a102 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 943 time: 0.0790868
May 28 14:29:51.715253 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-368f6263-7b5a-4346-92cd-9e5b1ba47673 req-052e40f7-4832-44c4-acc5-55de73b620f1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0375595
May 28 14:29:52.174817 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a75f2b7-012a-46e6-8672-928ad8142efd req-0365773c-0fa4-4c02-8cab-6f80fa3212e3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:52.176197 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a75f2b7-012a-46e6-8672-928ad8142efd req-0365773c-0fa4-4c02-8cab-6f80fa3212e3 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 945 time: 0.0782259
May 28 14:29:52.220053 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a75f2b7-012a-46e6-8672-928ad8142efd req-bdea72aa-7cfb-4fa8-9108-02ec90af333c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381963
May 28 14:29:52.705338 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:29:52.840429 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:29:52.854504 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af', 'network_id': '37e18bf5-545d-49a2-afdf-585587a7907f', 'port_id': 'cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af', 'mac_address': 'fa:16:3e:76:48:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 851, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:29:52.903617 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f534c457-7604-42bb-9271-487d531857c9 req-140e13e5-ac74-4d98-bfe7-571640bdb8c8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:52.905080 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f534c457-7604-42bb-9271-487d531857c9 req-140e13e5-ac74-4d98-bfe7-571640bdb8c8 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 943 time: 0.0829532
May 28 14:29:52.909695 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:52.927035 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:29:52.942089 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:29:52.950193 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f534c457-7604-42bb-9271-487d531857c9 req-421623da-e145-4976-b4e9-75ba636ee1a1 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383360
May 28 14:29:53.008023 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:53.009811 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:53.076939 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:53.084670 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.085012 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.085344 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.085672 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.085996 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.086317 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.086634 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.086957 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.087276 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.087621 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.087955 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.088249 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:29:53.091947 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:53.409735 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3228555f-1e38-48ab-bffa-adbff816f9af req-c75d748a-03e5-40e7-9172-b47ed76a83ce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:53.411157 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3228555f-1e38-48ab-bffa-adbff816f9af req-c75d748a-03e5-40e7-9172-b47ed76a83ce tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.90 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 945 time: 0.1372013
May 28 14:29:53.457349 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09de3de8-60bb-4118-ad41-dca1a0c8524b req-aafdd9c6-fef5-43a7-992f-62f950f53a90 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:53.458791 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-09de3de8-60bb-4118-ad41-dca1a0c8524b req-aafdd9c6-fef5-43a7-992f-62f950f53a90 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 945 time: 0.1323519
May 28 14:29:53.554847 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-09de3de8-60bb-4118-ad41-dca1a0c8524b req-3b3ee3ab-fd2d-4d73-b922-b3793d24c0cc tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/security-groups?id=9dbfc65b-288f-40c1-b875-e07271ac76fb&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0903277
May 28 14:29:53.591186 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-3228555f-1e38-48ab-bffa-adbff816f9af req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Deleting port 59657597-74b5-4611-a1d9-144ab84f71dc {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:29:53.591519 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3228555f-1e38-48ab-bffa-adbff816f9af req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:53.711877 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:29:53.722289 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-3228555f-1e38-48ab-bffa-adbff816f9af req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] For port 59657597-74b5-4611-a1d9-144ab84f71dc, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=59657597-74b5-4611-a1d9-144ab84f71dc,segment=NetworkSegment(dda0b714-8a1c-44e0-bb8a-72b17cf406ad),segment_id=dda0b714-8a1c-44e0-bb8a-72b17cf406ad)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:29:53.722647 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3228555f-1e38-48ab-bffa-adbff816f9af req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:53.849450 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-3228555f-1e38-48ab-bffa-adbff816f9af req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Calling delete_port for 59657597-74b5-4611-a1d9-144ab84f71dc owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:29:54.034218 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3228555f-1e38-48ab-bffa-adbff816f9af req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:54.040481 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-286b3d71-b367-4d85-b3c7-b030ca05adf5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:54.092135 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Pushing event deleted for resources: {'Port': ['ID=59657597-74b5-4611-a1d9-144ab84f71dc,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:54.098061 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:54.146928 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a00a7c5-4534-4cfb-9575-1f086d4a949d req-a7e47b10-96d7-4950-b606-02547b91149d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:54.148773 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9a00a7c5-4534-4cfb-9575-1f086d4a949d req-a7e47b10-96d7-4950-b606-02547b91149d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 944 time: 0.0925651
May 28 14:29:54.204118 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9a00a7c5-4534-4cfb-9575-1f086d4a949d req-6efee532-0874-4e3e-a411-a6466cd2872a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0494127
May 28 14:29:54.263821 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-3228555f-1e38-48ab-bffa-adbff816f9af req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] No DVR routers for this DVR port 59657597-74b5-4611-a1d9-144ab84f71dc on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:29:54.266302 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-3228555f-1e38-48ab-bffa-adbff816f9af req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:54.268781 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aa156ac4-b444-4c02-a917-602aa688fba6', 'name': 'network-vif-deleted', 'tag': '59657597-74b5-4611-a1d9-144ab84f71dc'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:29:54.312503 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aa156ac4-b444-4c02-a917-602aa688fba6', 'name': 'network-vif-deleted', 'tag': '59657597-74b5-4611-a1d9-144ab84f71dc', 'status': 'completed', 'code': 200}
May 28 14:29:54.340198 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3228555f-1e38-48ab-bffa-adbff816f9af req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.90 "DELETE /v2.0/ports/59657597-74b5-4611-a1d9-144ab84f71dc HTTP/1.1" status: 204  len: 173 time: 0.9217277
May 28 14:29:54.703276 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e41c6f49-c935-4e85-9dd3-2e7e0ceec59f req-a719df08-e1fd-408a-acfd-1af653dae18c tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] 10.222.0.59 "GET /v2.0/ports?device_id=aa156ac4-b444-4c02-a917-602aa688fba6 HTTP/1.1" status: 200  len: 210 time: 0.0414395
May 28 14:29:55.392379 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a550ca1-339f-4c64-8f7b-e734804871a6 req-37860f2f-71e7-4d2c-b94c-3fe667853164 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:55.393838 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0a550ca1-339f-4c64-8f7b-e734804871a6 req-37860f2f-71e7-4d2c-b94c-3fe667853164 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 944 time: 0.0829253
May 28 14:29:55.438031 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0a550ca1-339f-4c64-8f7b-e734804871a6 req-9b7bcd7e-9a5a-44de-94e9-67419601d75d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384874
May 28 14:29:56.620527 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-500da744-5207-49c5-920c-e2eedd7ccdfc req-2b07ab9c-2942-4838-b50e-ea2d2e9ef17e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:56.622258 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-500da744-5207-49c5-920c-e2eedd7ccdfc req-2b07ab9c-2942-4838-b50e-ea2d2e9ef17e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 944 time: 0.0800669
May 28 14:29:56.666363 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-500da744-5207-49c5-920c-e2eedd7ccdfc req-18986ef2-8354-408f-88f0-d958f163c624 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0378950
May 28 14:29:56.704339 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:29:56.856972 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:29:56.862544 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:29:56.862922 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:56.977794 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:57.004699 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9a7b74cb-2311-48b6-b58b-13c358c2c0bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:29:57.014418 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:29:57.047022 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9a7b74cb-2311-48b6-b58b-13c358c2c0bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af', 'code': 200}
May 28 14:29:57.105593 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:57.107049 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 59657597-74b5-4611-a1d9-144ab84f71dc no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:29:57.135122 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:29:57.179798 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 59657597-74b5-4611-a1d9-144ab84f71dc {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:29:57.180139 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 59657597-74b5-4611-a1d9-144ab84f71dc not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:29:57.206730 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:29:57.209868 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:29:57.452179 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5fd915-47ef-4294-9b80-06845d215da2 req-70be2e67-73ba-460d-b98f-32b1528b952b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:57.453621 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f5fd915-47ef-4294-9b80-06845d215da2 req-70be2e67-73ba-460d-b98f-32b1528b952b service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 1098 time: 0.0734808
May 28 14:29:57.502851 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4f5fd915-47ef-4294-9b80-06845d215da2 req-0175e682-9b0b-41e8-bf2c-32ab93e44a47 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0347495
May 28 14:29:57.851400 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:29:57.852756 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e53f02e0-62b2-407d-9a14-ba95b2076f6a req-6dd8c682-2ac1-47b7-80ae-685d53fbd5b4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:57.854255 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e53f02e0-62b2-407d-9a14-ba95b2076f6a req-6dd8c682-2ac1-47b7-80ae-685d53fbd5b4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 945 time: 0.0816483
May 28 14:29:57.902779 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e53f02e0-62b2-407d-9a14-ba95b2076f6a req-a6496441-a1fa-4bb4-bd48-eba7ff44215f tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426877
May 28 14:29:58.539515 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:29:59.088823 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34a24d85-5202-4b8d-acd1-38e637531a69 req-39715fdd-b748-4b1b-bdc1-afd0993ca0da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:29:59.090195 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-34a24d85-5202-4b8d-acd1-38e637531a69 req-39715fdd-b748-4b1b-bdc1-afd0993ca0da tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 945 time: 0.0822229
May 28 14:29:59.143033 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-34a24d85-5202-4b8d-acd1-38e637531a69 req-3dd8a37a-79b1-4d3b-be4d-d9e3ce47d538 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470867
May 28 14:30:00.030873 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-30dc9323-8491-4065-b439-c09259c95291 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:00.330971 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5165d1d3-faf8-4849-ad08-4a159095c781 req-16514313-dc1d-4c10-8e36-f2c58b3acfff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:00.332428 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5165d1d3-faf8-4849-ad08-4a159095c781 req-16514313-dc1d-4c10-8e36-f2c58b3acfff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 945 time: 0.0793114
May 28 14:30:00.375129 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5165d1d3-faf8-4849-ad08-4a159095c781 req-f021f0ec-6f66-45d2-a6b7-2bc80a40c7c7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0370576
May 28 14:30:02.491880 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-13d60bbf-e109-435b-b07c-fcef3f3521ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:02.493531 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:02.716357 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e733391-d009-4f0f-95b6-70e621aab018 req-391e6ffe-a299-4104-9569-22d9120f3540 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:02.717791 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7e733391-d009-4f0f-95b6-70e621aab018 req-391e6ffe-a299-4104-9569-22d9120f3540 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0844860
May 28 14:30:02.764400 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7e733391-d009-4f0f-95b6-70e621aab018 req-40ccee1b-08a0-49b0-a477-1b039d59f16b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0407996
May 28 14:30:03.693870 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:03.750285 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-7e27f277-fff5-430d-b359-768771d24045 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:03.752459 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-7e27f277-fff5-430d-b359-768771d24045 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=cf7193774c754e07a6f683666ab4addf&device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1138 time: 0.0742049
May 28 14:30:03.888332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-c07a363c-cf21-4416-8f6e-34ba96a3c53e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:03.889751 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-c07a363c-cf21-4416-8f6e-34ba96a3c53e service neutron] 10.222.0.90 "GET /v2.0/networks?id=780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 200  len: 915 time: 0.1287582
May 28 14:30:03.948850 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b2d7275-938b-4fee-a4f6-9da001120ef3 req-12f4472b-8b35-4f53-806d-c32d280bb963 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:03.950345 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2b2d7275-938b-4fee-a4f6-9da001120ef3 req-12f4472b-8b35-4f53-806d-c32d280bb963 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0800519
May 28 14:30:03.994888 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-93d46c18-facf-4670-a744-93455287884c service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 1002 time: 0.0980072
May 28 14:30:03.998151 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2b2d7275-938b-4fee-a4f6-9da001120ef3 req-fabe67f8-4e2b-4408-b4df-a9ff628adfe3 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0419352
May 28 14:30:04.057983 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-13c7a7ae-1e29-4b06-867d-ba1ddc820934 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:04.059397 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-13c7a7ae-1e29-4b06-867d-ba1ddc820934 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=31bcc630-98a7-46cc-9928-64d7da56d404 HTTP/1.1" status: 200  len: 853 time: 0.0576413
May 28 14:30:04.136460 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-21cbc94f-20dd-4527-9147-413373ccc4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:04.137869 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-21cbc94f-20dd-4527-9147-413373ccc4f3 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=780506d2-6c05-4b1f-af1f-a4a3d627ec86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0704689
May 28 14:30:04.273020 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-0aa1b8e8-78ee-4d5d-8773-d569febbf853 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1278627
May 28 14:30:04.404315 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b5984f92-804b-49f5-995a-1c9d8151ea85 req-f699b8a6-029e-4ef4-ab46-83c06c164913 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1240108
May 28 14:30:05.199364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca req-e4d97d8a-bcc1-4da0-8d51-19ecaef93976 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:05.200859 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca req-e4d97d8a-bcc1-4da0-8d51-19ecaef93976 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0819719
May 28 14:30:05.248926 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-edba4bfc-8660-46b9-bab9-4d14ef2ea3ca req-d7fe3fd3-0381-4edf-b2de-2e570db7d227 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0415533
May 28 14:30:05.365817 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:06.435677 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 req-bbfd7c5f-2a6f-4bc1-acd5-e09e8ac1c7fc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:06.437149 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 req-bbfd7c5f-2a6f-4bc1-acd5-e09e8ac1c7fc tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0854044
May 28 14:30:06.496446 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fc0cce2c-6092-4b18-9e78-07f216da7ee3 req-f2ad4d81-8741-4835-a028-5566809598bd tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0517766
May 28 14:30:07.694139 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 req-0364d107-f8e9-44d2-be5a-d0873074b105 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:07.695793 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 req-0364d107-f8e9-44d2-be5a-d0873074b105 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0859370
May 28 14:30:07.743204 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ea942cb6-803c-4fa6-9f07-1ce6e73464f2 req-4f6ee286-73c0-4120-9682-a21b57e12326 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0417085
May 28 14:30:08.928807 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033c1a65-a99e-4023-982a-9cabdea90c2e req-14582396-3320-41eb-ab6f-ce3e85ef93aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:08.930299 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-033c1a65-a99e-4023-982a-9cabdea90c2e req-14582396-3320-41eb-ab6f-ce3e85ef93aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0809295
May 28 14:30:09.059485 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-033c1a65-a99e-4023-982a-9cabdea90c2e req-1b49176a-ea31-4f54-8664-3398cdf1b22e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1231999
May 28 14:30:10.246398 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a32657a8-db91-430a-93f9-95ee60ba49b1 req-581aa5c7-97bc-4a12-929e-33ff537d3985 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:10.248148 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a32657a8-db91-430a-93f9-95ee60ba49b1 req-581aa5c7-97bc-4a12-929e-33ff537d3985 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0799475
May 28 14:30:10.294178 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a32657a8-db91-430a-93f9-95ee60ba49b1 req-037d9cb4-43c6-4691-ae76-a86bc8819d54 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0396671
May 28 14:30:11.480419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 req-8d44b273-577e-4d4c-8698-53c706a0ced1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:11.481939 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 req-8d44b273-577e-4d4c-8698-53c706a0ced1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0814233
May 28 14:30:11.529691 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a7d47a0c-6f4f-43bf-891e-a2375fc33d21 req-bcf6a998-2407-4a45-ac75-0ef022c15c23 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0414405
May 28 14:30:12.798024 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 req-3e86723b-2290-4bfe-8d18-7e7c972da1e4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:12.799485 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 req-3e86723b-2290-4bfe-8d18-7e7c972da1e4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.1634350
May 28 14:30:12.848272 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4ae083aa-1784-4d21-8d52-4339cec9f8e0 req-e634d730-6877-4817-94d1-5dd6a5781960 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0426280
May 28 14:30:14.032413 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87de45ea-3be3-44c8-88a8-736ab1f96222 req-fb787689-0547-40a9-80f2-d980fcfe2827 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:14.033873 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-87de45ea-3be3-44c8-88a8-736ab1f96222 req-fb787689-0547-40a9-80f2-d980fcfe2827 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0817099
May 28 14:30:14.080605 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-87de45ea-3be3-44c8-88a8-736ab1f96222 req-5a26543a-06e2-4881-a76f-0e472765b654 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0410247
May 28 14:30:15.266088 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80266ae1-29f5-4438-9012-37d15942d936 req-cd05192b-a418-455d-a3e7-7e9fcb9e89ee tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:15.268191 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-80266ae1-29f5-4438-9012-37d15942d936 req-cd05192b-a418-455d-a3e7-7e9fcb9e89ee tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0821166
May 28 14:30:15.316822 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-80266ae1-29f5-4438-9012-37d15942d936 req-0d939266-e282-4fae-b54f-454d630578b0 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0424054
May 28 14:30:16.498716 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738d951f-b251-40ac-80ee-10a3ed9eca40 req-4ca32769-f500-4e03-a776-45a76e0f587f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:16.500185 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-738d951f-b251-40ac-80ee-10a3ed9eca40 req-4ca32769-f500-4e03-a776-45a76e0f587f tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0784738
May 28 14:30:16.553084 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-738d951f-b251-40ac-80ee-10a3ed9eca40 req-2ea6bed5-151e-4605-b58d-24532a99a9de tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0462048
May 28 14:30:17.738172 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26108d38-45d3-4e1e-88a0-5cddbbc81003 req-5c2ef101-c281-4de5-8663-22fe81a3675d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:17.739655 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-26108d38-45d3-4e1e-88a0-5cddbbc81003 req-5c2ef101-c281-4de5-8663-22fe81a3675d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0795667
May 28 14:30:17.784704 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-26108d38-45d3-4e1e-88a0-5cddbbc81003 req-1e585a7d-c19a-46a0-af6c-203ea4846af1 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0393379
May 28 14:30:18.972672 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9788bb58-9117-47da-8518-e56d2aea0410 req-17660ad8-8fbd-49be-9399-e4f153134cf7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:18.974306 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9788bb58-9117-47da-8518-e56d2aea0410 req-17660ad8-8fbd-49be-9399-e4f153134cf7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0826800
May 28 14:30:19.023663 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9788bb58-9117-47da-8518-e56d2aea0410 req-717bb334-3a8f-40ab-a96b-c8d3b0d00e05 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0434375
May 28 14:30:20.363444 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7408daf-0bc0-43b9-8971-d6b368a955c2 req-d8be158d-f4bf-4143-b774-35fb8755a365 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:20.365069 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7408daf-0bc0-43b9-8971-d6b368a955c2 req-d8be158d-f4bf-4143-b774-35fb8755a365 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0864959
May 28 14:30:20.414142 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7408daf-0bc0-43b9-8971-d6b368a955c2 req-85feab88-9fe8-4d42-ab45-8861a3ad78e4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0432692
May 28 14:30:21.607906 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df2d67b-91b8-49e6-a83c-af6da15b960f req-4a86fc0f-b36b-4252-9206-7d41116e25ef tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:21.609278 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5df2d67b-91b8-49e6-a83c-af6da15b960f req-4a86fc0f-b36b-4252-9206-7d41116e25ef tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0843623
May 28 14:30:21.655977 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5df2d67b-91b8-49e6-a83c-af6da15b960f req-72b4b8eb-ca4a-48ac-bbe0-8b3004f326a5 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&id=3d863428-3f5e-4b80-a607-bbb4325e640a&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0401700
May 28 14:30:24.576056 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de35db9b-050a-424c-a975-2421fca400ad req-4a4d3ece-a149-4093-bb80-b6aaae687c6d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:24.577616 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-de35db9b-050a-424c-a975-2421fca400ad req-4a4d3ece-a149-4093-bb80-b6aaae687c6d tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 945 time: 0.0822022
May 28 14:30:24.624457 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-de35db9b-050a-424c-a975-2421fca400ad req-87ca42da-e54f-4235-9714-b09686f88902 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406613
May 28 14:30:25.806599 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 req-2da6e1f3-1adc-4171-8914-22ddf9ad8667 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:25.807981 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 req-2da6e1f3-1adc-4171-8914-22ddf9ad8667 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 945 time: 0.0793481
May 28 14:30:25.853267 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8b2f155c-80c4-431b-af5c-8b7a0b7a3928 req-3bab18a3-47cc-486d-aa8d-934b851dffd7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390623
May 28 14:30:26.883306 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-9066954a-4c53-4a08-8e13-57e9a401904e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:26.884781 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-9066954a-4c53-4a08-8e13-57e9a401904e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 945 time: 0.0821505
May 28 14:30:27.035963 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Deleting port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:30:27.036302 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:27.055042 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 req-35006752-289d-4c57-aa81-2ec688f65f04 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:27.056575 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 req-35006752-289d-4c57-aa81-2ec688f65f04 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 945 time: 0.0965426
May 28 14:30:27.104120 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4f4a1639-4f05-4759-adbb-1ddff9b4b3a3 req-2171bef6-89e9-4ec5-9ba4-8646166dc73a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418711
May 28 14:30:27.173870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] For port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:27.174213 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:27.296055 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling delete_port for cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:30:27.470971 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:27.477654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-abfc43b6-4409-4cc1-b408-145cfe16a549 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:27.483880 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'c5a95e0a-897e-42cc-bae7-653a3a321292', '827d9299-b0be-4acd-a8ae-13dd5fbf53f3', 'cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:30:27.524740 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Pushing event deleted for resources: {'Port': ['ID=cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:27.560596 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.560974 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.561340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.561702 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.562062 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.562417 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.562776 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.563133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.563481 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.563929 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.564280 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.564628 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:27.572145 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:27.614018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] No DVR routers for this DVR port cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:30:27.616521 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:27.619150 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9a7b74cb-2311-48b6-b58b-13c358c2c0bb', 'name': 'network-vif-deleted', 'tag': 'cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:30:27.666407 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9a7b74cb-2311-48b6-b58b-13c358c2c0bb', 'name': 'network-vif-deleted', 'tag': 'cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af', 'status': 'completed', 'code': 200}
May 28 14:30:27.703361 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0c2682c2-5cb8-4d11-8627-a805c7b93dd1 req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "DELETE /v2.0/ports/cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af HTTP/1.1" status: 204  len: 173 time: 0.8129749
May 28 14:30:27.888206 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:28.272940 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c697ba57-323a-489e-ba53-8233fc039325 req-c42a0dd4-dc4b-4b38-9789-b4ecf09482f3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=9a7b74cb-2311-48b6-b58b-13c358c2c0bb HTTP/1.1" status: 200  len: 210 time: 0.0435297
May 28 14:30:30.085390 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0f1e9ae1-6489-4aad-be91-82db9d3a6e1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:30.586570 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-a0926b19-7d58-48d8-b1c0-7d833d6280b7 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0746298
May 28 14:30:30.682803 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-62ecdd12-e090-4767-a47f-6bc735e2ba42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:30.684345 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-62ecdd12-e090-4767-a47f-6bc735e2ba42 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=cf7193774c754e07a6f683666ab4addf&device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1138 time: 0.0711043
May 28 14:30:30.836052 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-969fc62f-be1e-41cc-8c62-bdd31e2c7090 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:30.837566 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-969fc62f-be1e-41cc-8c62-bdd31e2c7090 service neutron] 10.222.0.90 "GET /v2.0/networks?id=780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 200  len: 915 time: 0.1329279
May 28 14:30:30.908834 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:30:30.948204 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:30:30.948551 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device cf0d8704-8fbd-40dd-9d6c-d1ceb7c234af not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:30:31.020064 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-a90675db-2a6b-4897-a849-350fc26b698b service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 1002 time: 0.1754553
May 28 14:30:31.046892 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38320) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:31.095377 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-fd78fbee-97c2-401d-a7f5-b5d0305ba27b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:31.095377 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-fd78fbee-97c2-401d-a7f5-b5d0305ba27b service neutron] 10.222.0.90 "GET /v2.0/subnets?id=31bcc630-98a7-46cc-9928-64d7da56d404 HTTP/1.1" status: 200  len: 853 time: 0.0653105
May 28 14:30:31.171984 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-dc2ed2dd-366a-4730-828d-704e2786438a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:31.173583 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-dc2ed2dd-366a-4730-828d-704e2786438a service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=780506d2-6c05-4b1f-af1f-a4a3d627ec86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0738349
May 28 14:30:31.284735 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_v2 [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Deleting subnet 00f80d27-adb3-4b05-9355-ad0adc3a3490 {{(pid=92694) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:30:31.287926 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:31.338666 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1655020'] for subnet, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:31.384157 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-a2be869c-fb25-450e-870d-68427331c86e service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1932817
May 28 14:30:31.395004 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:31.396177 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685fe009-a00a-473c-bc37-2e3b27ab4be2 req-7ec047f3-3f6c-454f-892d-7ff2206d0146 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:31.396871 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-685fe009-a00a-473c-bc37-2e3b27ab4be2 req-7ec047f3-3f6c-454f-892d-7ff2206d0146 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:30:31.533385 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-169cf026-db0e-4fb2-abd7-83221192c6ff req-8cb47552-6e1e-4f3d-85d5-26ea67e36eff service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1337087
May 28 14:30:31.602500 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-685fe009-a00a-473c-bc37-2e3b27ab4be2 req-7ec047f3-3f6c-454f-892d-7ff2206d0146 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:30:31.603684 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685fe009-a00a-473c-bc37-2e3b27ab4be2 req-7ec047f3-3f6c-454f-892d-7ff2206d0146 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 946 time: 0.3354354
May 28 14:30:31.650148 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-685fe009-a00a-473c-bc37-2e3b27ab4be2 req-7dfdf5f7-c846-442a-b35c-36dbf233b5ae tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404952
May 28 14:30:31.757411 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3483512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3521832'] for subnet, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:31.761536 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:31.797552 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=00f80d27-adb3-4b05-9355-ad0adc3a3490,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:31.807498 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:31.810481 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.814459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:31.820071 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:31.820922 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6f08a398-adbd-4eb0-8fe0-789676c4ff59 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/00f80d27-adb3-4b05-9355-ad0adc3a3490 HTTP/1.1" status: 204  len: 168 time: 0.7731013
May 28 14:30:31.823490 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38328) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:31.924454 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.049102 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.061648 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba22513d0>,) {'filters': {'network_id': ['8023cc33-82ed-49b2-a8e8-69839a1ff66e']}} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:32.073148 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba22513d0>, 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad') {'for_net_delete': True} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:32.073438 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba22513d0>, 'dda0b714-8a1c-44e0-bb8a-72b17cf406ad') {} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:32.084947 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1655015'] for segment, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.100592 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.106352 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Releasing vlan 882 on physical network physnet1 to pool {{(pid=92694) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:30:32.106721 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3422942'] for segment, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]: Traceback (most recent call last):
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     timer()
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     cb(*args, **kw)
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     return func(*args, **kwargs)
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     self._notify()
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     self.callback(batched_events)
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     event.method(event)
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     return f(self, *a, **k)
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._get(url).json()
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self.request(url, 'GET', **kwargs)
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:30:32.119309 dv-cinder-791281-3-iscsi neutron-server[92694]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:30:32.250563 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.254748 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:32.267634 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.279769 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Pushing event deleted for resources: {'Network': ['ID=8023cc33-82ed-49b2-a8e8-69839a1ff66e,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:32.282540 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:32.371464 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-100a7c62-47d0-4420-beb0-cd1d7615b5c9 admin admin] 10.222.0.59 "DELETE /v2.0/networks/8023cc33-82ed-49b2-a8e8-69839a1ff66e HTTP/1.1" status: 204  len: 168 time: 0.5469401
May 28 14:30:32.528648 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.531101 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3627732b-7215-4c54-88ea-9f2f19ee99ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.722586 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38336) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:32.771390 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c7f41d8e-1674-4599-a0f7-47daad09ae79 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=1db248e02dac49bf8688658eb42ee752&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0475814
May 28 14:30:32.773709 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38340) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:32.833854 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-d712aee8-902a-449a-ad8a-c575d156a5fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.840192 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eba2548-7f89-4622-99e1-44d7af032b2b req-c8bd310e-a8e1-45c5-b92a-1cd91e0e1073 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:32.841682 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3eba2548-7f89-4622-99e1-44d7af032b2b req-c8bd310e-a8e1-45c5-b92a-1cd91e0e1073 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 946 time: 0.0839574
May 28 14:30:32.859967 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-d712aee8-902a-449a-ad8a-c575d156a5fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:32.889285 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3eba2548-7f89-4622-99e1-44d7af032b2b req-fa76469d-ca7f-44f8-a1fc-54704a1b2e2a tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417063
May 28 14:30:33.005149 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-d712aee8-902a-449a-ad8a-c575d156a5fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:33.009249 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fd266fda-74d9-4512-ac25-67ddcfa8e8fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:33.024830 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d712aee8-902a-449a-ad8a-c575d156a5fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9dbfc65b-288f-40c1-b875-e07271ac76fb,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:33.027360 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-d712aee8-902a-449a-ad8a-c575d156a5fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:33.101207 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-d712aee8-902a-449a-ad8a-c575d156a5fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:33.102241 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-d712aee8-902a-449a-ad8a-c575d156a5fd admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/9dbfc65b-288f-40c1-b875-e07271ac76fb HTTP/1.1" status: 204  len: 168 time: 0.3275568
May 28 14:30:33.723214 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:33.735951 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-8eea28ad-881c-4ada-b778-b0d487ed5a33 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:33.737377 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-8eea28ad-881c-4ada-b778-b0d487ed5a33 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 946 time: 0.0789268
May 28 14:30:33.877434 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Deleting port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:30:33.878291 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:34.061654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] For port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:34.062004 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:34.203107 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling delete_port for 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:30:34.238134 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38366) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:34.238668 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6eb8641-0d88-4301-a8b6-143825b7827f req-48d73197-bd12-4b73-b04e-1af316b2a158 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:34.239830 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6eb8641-0d88-4301-a8b6-143825b7827f req-48d73197-bd12-4b73-b04e-1af316b2a158 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 946 time: 0.2412887
May 28 14:30:34.292063 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6eb8641-0d88-4301-a8b6-143825b7827f req-03351f53-3e39-495b-b27c-e59b63b819af tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462084
May 28 14:30:34.356354 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-7032008-network', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:34.361074 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:34.365452 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Usage tracker for resource:network and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:34.380456 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:34.380456 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:34.497464 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:34.503040 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-bbccc29a-0720-462e-9b19-2c7b1d69284c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:34.509388 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'c5a95e0a-897e-42cc-bae7-653a3a321292', '827d9299-b0be-4acd-a8ae-13dd5fbf53f3'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:30:34.533670 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Made reservation on behalf of 26daec94fed843c8b74a9ff7d18ecdb5 for: {'network': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:30:34.536664 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:34.551420 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:34.552852 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Pushing event deleted for resources: {'Port': ['ID=827d9299-b0be-4acd-a8ae-13dd5fbf53f3,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:34.556106 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:34.577208 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:34.581166 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Usage tracker for resource:security_group_rule and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:34.584684 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:34.591693 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:34.630446 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] No DVR routers for this DVR port 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:30:34.635528 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:34.638923 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd99f06a3-aa59-4312-820e-f3852cd77ac1', 'name': 'network-vif-deleted', 'tag': '827d9299-b0be-4acd-a8ae-13dd5fbf53f3'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:30:34.694906 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd99f06a3-aa59-4312-820e-f3852cd77ac1', 'name': 'network-vif-deleted', 'tag': '827d9299-b0be-4acd-a8ae-13dd5fbf53f3', 'status': 'completed', 'code': 200}
May 28 14:30:34.739625 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0a1d2ef5-916c-4206-9dd0-0ceb574a8ba4 req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "DELETE /v2.0/ports/827d9299-b0be-4acd-a8ae-13dd5fbf53f3 HTTP/1.1" status: 204  len: 173 time: 0.9952679
May 28 14:30:34.767163 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:34.827719 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:34.830779 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6e6992b7-905d-423e-af65-5f774ddbae4a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:34.859033 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-71075329-9931-4246-affc-9097a427d30a admin admin] vlan segment allocate from pool success with {'vlan_id': 880, 'physical_network': 'physnet1'}  {{(pid=92694) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:30:34.868244 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77ee19df-86c8-4660-997d-e1674cca7f09,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:34.871731 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:34.874401 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:34.874739 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.segments_db [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Added segment 1813f8c2-f7d0-4718-afc9-11b527ec49a2 of type vlan for network cf0db8bd-5a73-44bf-9367-58867c9e819f
May 28 14:30:34.901914 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:35.188314 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:35.189639 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:35.190337 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:35.194032 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a3c825d3-d4f3-49f2-8092-42f4a06a9c11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:35.295294 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Pushing event updated for resources: {'Network': ['ID=cf0db8bd-5a73-44bf-9367-58867c9e819f,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:35.298220 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:35.305566 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network cf0db8bd-5a73-44bf-9367-58867c9e819f details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:30:35.371527 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:35.440874 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-71075329-9931-4246-affc-9097a427d30a admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 879 time: 1.2007291
May 28 14:30:35.443486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38376) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:35.449243 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Request body: {'subnet': {'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-7032008-subnet', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:35.454255 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:35.459041 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Usage tracker for resource:subnet and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:35.462271 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:35.468634 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:35.538606 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:30:35.542490 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-808aa560-35a7-4075-ab3a-0c26770710ed req-3e11d868-fdaa-4fb7-8810-fc8e8dcfe2d7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:30:35.545007 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Made reservation on behalf of 26daec94fed843c8b74a9ff7d18ecdb5 for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:30:35.553526 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3521847'] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:35.644085 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-808aa560-35a7-4075-ab3a-0c26770710ed req-3e11d868-fdaa-4fb7-8810-fc8e8dcfe2d7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:30:35.645406 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-808aa560-35a7-4075-ab3a-0c26770710ed req-3e11d868-fdaa-4fb7-8810-fc8e8dcfe2d7 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=d99f06a3-aa59-4312-820e-f3852cd77ac1 HTTP/1.1" status: 200  len: 210 time: 0.2340574
May 28 14:30:36.012553 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483451', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3521825'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:36.017068 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:36.092057 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Pushing event updated for resources: {'Subnet': ['ID=4a437a5e-a3c1-4c29-a8be-fade6c84b5f4,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:36.095482 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:36.098993 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Checking segment: {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:30:36.099354 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Network hostable DHCP agents. Network: cf0db8bd-5a73-44bf-9367-58867c9e819f, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:30:36.184965 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Network cf0db8bd-5a73-44bf-9367-58867c9e819f is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:30:36.273883 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, cf0db8bd-5a73-44bf-9367-58867c9e819f) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:36.281610 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1b0a645-7428-45ae-8361-5d907ea4f4db None None] Network cf0db8bd-5a73-44bf-9367-58867c9e819f requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:30:36.285019 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:36.285622 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:36.408480 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-2140c6a4-85e4-4f5c-a17a-d0f5fefdee4c admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 842 time: 0.9637663
May 28 14:30:36.411044 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38382) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:36.416351 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:36.421497 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:36.425798 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Usage tracker for resource:router and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:36.428854 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:36.434605 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:36.498226 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-cf0db8bd-5a73-44bf-9367-58867c9e819f', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:30:36.499054 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:36.513693 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:36.514742 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:36.531649 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:36.651175 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Allocated IP 172.20.0.2 (cf0db8bd-5a73-44bf-9367-58867c9e819f/4a437a5e-a3c1-4c29-a8be-fade6c84b5f4/1a7a8e2b-102b-4640-a14f-f3ec6f33841c) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:30:36.880585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:36.886769 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:36.891264 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Transition to ACTIVE for port object 1a7a8e2b-102b-4640-a14f-f3ec6f33841c will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:36.910036 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Transition to ACTIVE for port object 1a7a8e2b-102b-4640-a14f-f3ec6f33841c will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:36.938603 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:30:36.973344 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:30:36.973689 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 827d9299-b0be-4acd-a8ae-13dd5fbf53f3 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:30:37.111112 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:37.111112 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:37.199435 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Network cf0db8bd-5a73-44bf-9367-58867c9e819f is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:30:37.202529 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:37.206401 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:30:37.215321 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Pushing event updated for resources: {'Port': ['ID=1a7a8e2b-102b-4640-a14f-f3ec6f33841c,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:37.248021 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:37.299195 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Attempting to bind port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:30:37.323397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Attempting to bind port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:30:37.323397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Attempting to bind port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c on network cf0db8bd-5a73-44bf-9367-58867c9e819f {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:30:37.323397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 30, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:30:37.323397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Checking segment: {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:30:37.323397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:37.323397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Bound using segment: {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:30:37.323397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Bound port: 1a7a8e2b-102b-4640-a14f-f3ec6f33841c, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:30:37.323397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:37.371932 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:37.400079 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] For port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:30:37.403211 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:37.403539 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] For port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=1a7a8e2b-102b-4640-a14f-f3ec6f33841c,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:30:37.648855 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:37.652839 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:37.682683 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Allocated IP 172.27.3.191 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/b3e9be66-7166-49e8-824c-85e4f7c23ea5) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:30:37.696833 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea00753-c01c-429c-ad05-cef262016489 req-7c7e3d75-e920-45bd-aaed-244062b78ba6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:37.698294 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2ea00753-c01c-429c-ad05-cef262016489 req-7c7e3d75-e920-45bd-aaed-244062b78ba6 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 945 time: 0.1542413
May 28 14:30:37.731899 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Pushing event updated for resources: {'Port': ['ID=1a7a8e2b-102b-4640-a14f-f3ec6f33841c,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:37.736560 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:37.830117 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2ea00753-c01c-429c-ad05-cef262016489 req-33149786-935c-496b-bf75-a690c26b5130 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1252823
May 28 14:30:37.890679 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:38.131381 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:38.135650 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:38.206035 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:30:38.206035 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:38.206035 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:30:38.239609 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Pushing event updated for resources: {'Port': ['ID=b3e9be66-7166-49e8-824c-85e4f7c23ea5,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:38.245512 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:38.662093 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4cdb295-b59a-4219-a55a-f36f62fd5137 None None] Network cf0db8bd-5a73-44bf-9367-58867c9e819f requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:30:38.728264 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:38.822653 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-f1699d9b-6523-4e21-8cbc-c02f0bddf51e None None] Provisioning for port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:39.025279 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd req-620b1a47-0e0d-4f8c-9ec4-fbb5b76685fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:39.027682 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd req-620b1a47-0e0d-4f8c-9ec4-fbb5b76685fe tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 945 time: 0.0864773
May 28 14:30:39.119120 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-49b03d64-6a7d-45e9-8f2f-cdf4680347bd req-6e742511-bf25-4a28-aead-864f1355ef13 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0767345
May 28 14:30:39.122077 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:39.134563 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 1a7a8e2b-102b-4640-a14f-f3ec6f33841c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:39.314337 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:39.320639 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:39.327314 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:39.455511 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:39.490493 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=1a7a8e2b-102b-4640-a14f-f3ec6f33841c,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:39.513591 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Router 094f20c9-a78b-4f13-89ee-236a84d949e7 is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92694) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:30:39.577078 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:39.580729 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:39.660351 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=1a7a8e2b-102b-4640-a14f-f3ec6f33841c,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:39.663902 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:39.664474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-c5f85337-9a0d-4b25-be76-7d4cc29bf1e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:39.665817 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-c5f85337-9a0d-4b25-be76-7d4cc29bf1e2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 945 time: 0.1030707
May 28 14:30:39.712929 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:30:39.724864 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Sync routers for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:30:39.734851 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:39.735486 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27e54c0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:39.819778 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Deleting port c5a95e0a-897e-42cc-bae7-653a3a321292 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:30:39.820432 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:39.821129 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Notify callbacks [] for router, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:39.822440 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 918 time: 3.4103577
May 28 14:30:39.825235 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38394) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:39.946276 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:39.977035 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] For port c5a95e0a-897e-42cc-bae7-653a3a321292, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c5a95e0a-897e-42cc-bae7-653a3a321292,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:39.977392 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:40.123050 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling delete_port for c5a95e0a-897e-42cc-bae7-653a3a321292 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:30:40.282676 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27e54c0>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:38Z', 'revision_number': 3, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:40.287987 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Checking router: 094f20c9-a78b-4f13-89ee-236a84d949e7 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:30:40.288769 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Updating router 094f20c9-a78b-4f13-89ee-236a84d949e7 port b3e9be66-7166-49e8-824c-85e4f7c23ea5 binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:30:40.348796 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:40.409408 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:40.420639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cd985c7c-ea6b-4fd9-b799-cffb88534c37 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:40.455357 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'c5a95e0a-897e-42cc-bae7-653a3a321292'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:30:40.489555 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Pushing event deleted for resources: {'Port': ['ID=c5a95e0a-897e-42cc-bae7-653a3a321292,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:40.508692 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:40.554916 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 req-b4a21a05-8e0d-476d-9099-63ed5b65cf11 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:40.556462 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 req-b4a21a05-8e0d-476d-9099-63ed5b65cf11 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 945 time: 0.2425294
May 28 14:30:40.603190 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] No DVR routers for this DVR port c5a95e0a-897e-42cc-bae7-653a3a321292 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:30:40.606531 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:40.611304 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fecfff25-834b-4f86-b9dc-0e95c9fba46d', 'name': 'network-vif-deleted', 'tag': 'c5a95e0a-897e-42cc-bae7-653a3a321292'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:30:40.689080 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fecfff25-834b-4f86-b9dc-0e95c9fba46d', 'name': 'network-vif-deleted', 'tag': 'c5a95e0a-897e-42cc-bae7-653a3a321292', 'status': 'completed', 'code': 200}
May 28 14:30:40.724753 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9ea4f229-e8ed-417b-8c35-437560b54d0e req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "DELETE /v2.0/ports/c5a95e0a-897e-42cc-bae7-653a3a321292 HTTP/1.1" status: 204  len: 173 time: 1.0524247
May 28 14:30:40.741213 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ffc7f721-e75d-4d8c-8401-1dd16624bcc9 req-0c2f330c-941b-4cb6-96ad-84c564907e7c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1127837
May 28 14:30:40.762740 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:40.960475 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:40.974958 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Transition to ACTIVE for port object b3e9be66-7166-49e8-824c-85e4f7c23ea5 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:41.012743 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Allocated IP 172.20.0.1 (cf0db8bd-5a73-44bf-9367-58867c9e819f/4a437a5e-a3c1-4c29-a8be-fade6c84b5f4/b1668072-a83a-4a97-b60d-54f1d0a5a421) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:30:41.054085 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:41.059275 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:41.100883 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 1a7a8e2b-102b-4640-a14f-f3ec6f33841c up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:41.192558 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:41.201400 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Attempting to bind port b3e9be66-7166-49e8-824c-85e4f7c23ea5 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:30:41.201828 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Attempting to bind port b3e9be66-7166-49e8-824c-85e4f7c23ea5 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:30:41.202213 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Attempting to bind port b3e9be66-7166-49e8-824c-85e4f7c23ea5 on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:30:41.207270 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175710a2-e19d-4c39-a10a-a9163028f412 None None] Pushing event updated for resources: {'Port': ['ID=b3e9be66-7166-49e8-824c-85e4f7c23ea5,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:41.221966 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.provisioning_blocks [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Transition to ACTIVE for port object b1668072-a83a-4a97-b60d-54f1d0a5a421 will not be triggered until provisioned by entity DHCP. {{(pid=92694) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:41.222365 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-175710a2-e19d-4c39-a10a-a9163028f412 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:41.222365 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 30, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:30:41.222365 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:30:41.222365 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:41.222365 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:30:41.222365 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Bound port: b3e9be66-7166-49e8-824c-85e4f7c23ea5, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:30:41.222365 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:41.299958 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:41.300342 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:41.311957 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:41.316123 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:41.329598 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] For port b3e9be66-7166-49e8-824c-85e4f7c23ea5, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:30:41.353160 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] For port b3e9be66-7166-49e8-824c-85e4f7c23ea5, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=b3e9be66-7166-49e8-824c-85e4f7c23ea5,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:30:41.442792 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:41.447049 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-0b462502-0488-4619-ad5c-9a272614279a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:41.517317 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Network cf0db8bd-5a73-44bf-9367-58867c9e819f is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:30:41.521226 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:41.524330 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:41.525074 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27e54c0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:41.526629 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:30:41.582254 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Pushing event updated for resources: {'Port': ['ID=b1668072-a83a-4a97-b60d-54f1d0a5a421,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:41.587119 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:41.593570 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175710a2-e19d-4c39-a10a-a9163028f412 None None] Pushing event updated for resources: {'Port': ['ID=b3e9be66-7166-49e8-824c-85e4f7c23ea5,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:41.601090 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-175710a2-e19d-4c39-a10a-a9163028f412 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:41.618020 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:41.734965 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:41.980521 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 req-a577ad97-4e32-484f-9f2d-eb34ac4a43f4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:30:42.042764 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-6715d798-b5be-413c-b47c-ce643d88ce4e None None] Provisioning for port b1668072-a83a-4a97-b60d-54f1d0a5a421 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:42.051026 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-6715d798-b5be-413c-b47c-ce643d88ce4e None None] Provisioning complete for port b1668072-a83a-4a97-b60d-54f1d0a5a421 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:42.051491 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6715d798-b5be-413c-b47c-ce643d88ce4e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:42.067807 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:42.086043 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 req-a577ad97-4e32-484f-9f2d-eb34ac4a43f4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:30:42.087706 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3ca19ba2-3ba8-4f4e-b3f7-95e681299ba1 req-a577ad97-4e32-484f-9f2d-eb34ac4a43f4 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=fecfff25-834b-4f86-b9dc-0e95c9fba46d HTTP/1.1" status: 200  len: 210 time: 0.1563175
May 28 14:30:42.090678 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27e54c0>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:38Z', 'revision_number': 3, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:42.110761 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a1f129-ec12-48ac-9b66-ef86d8dc9b37 None None] The sync data for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi is: [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:38Z', 'revision_number': 3, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:30:42.119681 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-6715d798-b5be-413c-b47c-ce643d88ce4e None None] Port b1668072-a83a-4a97-b60d-54f1d0a5a421 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:30:42.338793 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:42.442679 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:42.475207 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:42.558860 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:42.563673 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Pushing event updated for resources: {'Port': ['ID=b1668072-a83a-4a97-b60d-54f1d0a5a421,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:42.567494 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:42.717165 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Network cf0db8bd-5a73-44bf-9367-58867c9e819f is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:30:42.718493 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:42.936734 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Router 094f20c9-a78b-4f13-89ee-236a84d949e7 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:30:42.958756 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-10351e62-8b4c-4bac-b155-4ebda2b5a214 None None] Provisioning complete for port b1668072-a83a-4a97-b60d-54f1d0a5a421 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:42.959218 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-10351e62-8b4c-4bac-b155-4ebda2b5a214 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:42.995499 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c5a95e0a-897e-42cc-bae7-653a3a321292 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:30:43.053606 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: c5a95e0a-897e-42cc-bae7-653a3a321292 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:30:43.054253 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c5a95e0a-897e-42cc-bae7-653a3a321292 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:30:43.072706 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-10351e62-8b4c-4bac-b155-4ebda2b5a214 None None] Port b1668072-a83a-4a97-b60d-54f1d0a5a421 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:30:43.116451 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device b3e9be66-7166-49e8-824c-85e4f7c23ea5 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:43.166668 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:30:43.181865 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] 10.222.0.59 "PUT /v2.0/routers/094f20c9-a78b-4f13-89ee-236a84d949e7/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.3554997
May 28 14:30:43.365014 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port b3e9be66-7166-49e8-824c-85e4f7c23ea5 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:43.370060 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port b3e9be66-7166-49e8-824c-85e4f7c23ea5 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:43.370440 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:43.532325 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:43.553536 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port b3e9be66-7166-49e8-824c-85e4f7c23ea5, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=b3e9be66-7166-49e8-824c-85e4f7c23ea5,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:43.719831 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:43.721948 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:43.800051 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=b3e9be66-7166-49e8-824c-85e4f7c23ea5,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:43.803598 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:43.868413 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Sync routers for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:30:43.880907 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:43.881613 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba246b880>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:44.068339 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:44.134201 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38426) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:44.141976 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-455735731-network', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:44.148507 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:44.152974 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Usage tracker for resource:network and tenant:c8294323eb2a41b6875b41f3ee440d11 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:44.156053 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:44.162687 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:44.359244 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Made reservation on behalf of c8294323eb2a41b6875b41f3ee440d11 for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:30:44.359244 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.374691 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.391092 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:44.396517 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Usage tracker for resource:security_group_rule and tenant:c8294323eb2a41b6875b41f3ee440d11 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:44.399446 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:44.405837 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:44.421968 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba246b880>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'b1668072-a83a-4a97-b60d-54f1d0a5a421', 'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'mac_address': 'fa:16:3e:05:96:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 541, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:40Z', 'updated_at': '2021-05-28T14:30:42Z', 'revision_number': 2, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'subnets': [{'id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:44.426823 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Checking router: 094f20c9-a78b-4f13-89ee-236a84d949e7 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:30:44.427181 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Updating router 094f20c9-a78b-4f13-89ee-236a84d949e7 port b1668072-a83a-4a97-b60d-54f1d0a5a421 binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:30:44.488079 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.503940 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.617807 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.621325 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f1c3fbc4-8c71-47d6-aafb-2d647d626a23 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:44.647164 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] vlan segment allocate from pool success with {'vlan_id': 873, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:30:44.661018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25ccd21f-41fd-40ae-8c6f-8678f97ae79a,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:44.665038 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:44.665990 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.666329 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Added segment f0502c45-65a2-4857-a8a8-8ecc114c3345 of type vlan for network 69506df2-d621-488b-81b1-55216d075161
May 28 14:30:44.700818 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.854040 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.866877 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Transition to ACTIVE for port object b1668072-a83a-4a97-b60d-54f1d0a5a421 will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:44.905375 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.905375 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:44.905375 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:44.910439 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8bc21647-f93f-4aaf-8bb1-b7c24947dd5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:45.022384 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Pushing event updated for resources: {'Network': ['ID=69506df2-d621-488b-81b1-55216d075161,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:45.025218 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:45.032839 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network 69506df2-d621-488b-81b1-55216d075161 details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:30:45.045318 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:45.050144 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:45.131474 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device b3e9be66-7166-49e8-824c-85e4f7c23ea5 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:45.167533 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38434) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:45.168298 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 1.0291588
May 28 14:30:45.170687 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Request body: {'subnet': {'network_id': '69506df2-d621-488b-81b1-55216d075161', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-455735731-subnet', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:45.186684 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:45.201379 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Usage tracker for resource:subnet and tenant:c8294323eb2a41b6875b41f3ee440d11 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:45.206611 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:45.214802 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:45.219633 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Pushing event updated for resources: {'Port': ['ID=b1668072-a83a-4a97-b60d-54f1d0a5a421,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:45.242028 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port b3e9be66-7166-49e8-824c-85e4f7c23ea5 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:45.243420 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:45.269793 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.270132 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.270462 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.270785 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.271100 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.271417 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.271988 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.273788 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.274923 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.274923 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.274923 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.275217 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:45.287696 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:45.310208 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Attempting to bind port b1668072-a83a-4a97-b60d-54f1d0a5a421 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:30:45.310725 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Attempting to bind port b1668072-a83a-4a97-b60d-54f1d0a5a421 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:30:45.311183 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Attempting to bind port b1668072-a83a-4a97-b60d-54f1d0a5a421 on network cf0db8bd-5a73-44bf-9367-58867c9e819f {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:30:45.318143 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 30, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:30:45.326634 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Checking segment: {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:30:45.326634 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:45.326634 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Bound using segment: {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:30:45.326634 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Bound port: b1668072-a83a-4a97-b60d-54f1d0a5a421, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:30:45.326634 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:45.384316 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Made reservation on behalf of c8294323eb2a41b6875b41f3ee440d11 for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:30:45.390521 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3521847'] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:45.447548 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] For port b1668072-a83a-4a97-b60d-54f1d0a5a421, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:30:45.450936 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] For port b1668072-a83a-4a97-b60d-54f1d0a5a421, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=b1668072-a83a-4a97-b60d-54f1d0a5a421,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:30:45.585704 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:45.590257 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-ff60349c-f764-40dc-8c8a-ec12e3aa415a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:45.644993 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1cc03e-2eae-4263-a57e-94999a861535 req-e108940b-26a8-45b1-8806-fc7abdd80a1e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:45.646791 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9a1cc03e-2eae-4263-a57e-94999a861535 req-e108940b-26a8-45b1-8806-fc7abdd80a1e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.1469047
May 28 14:30:45.682259 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:45.682648 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba246b880>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:45.756190 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Pushing event updated for resources: {'Port': ['ID=b1668072-a83a-4a97-b60d-54f1d0a5a421,revision_number=4']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:45.760506 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-48cd057f-c8cd-4bb2-bf2f-4762f20dceb6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:45.852472 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9a1cc03e-2eae-4263-a57e-94999a861535 req-7991917a-55bd-46cb-99e0-b5df94008c20 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1911156
May 28 14:30:45.903039 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:46.140331 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483451', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3521825'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:46.145422 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:46.222805 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e680abde-f402-47b8-b002-0b0e1d84f679,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:46.229588 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:46.235691 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Checking segment: {'id': 'f0502c45-65a2-4857-a8a8-8ecc114c3345', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '69506df2-d621-488b-81b1-55216d075161'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:30:46.236144 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Network hostable DHCP agents. Network: 69506df2-d621-488b-81b1-55216d075161, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:30:46.270395 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba246b880>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'b1668072-a83a-4a97-b60d-54f1d0a5a421', 'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'mac_address': 'fa:16:3e:05:96:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 541, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:40Z', 'updated_at': '2021-05-28T14:30:45Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'subnets': [{'id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:46.274315 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a9a5da3-3db2-41a1-84aa-ebc88ca683da None None] The sync data for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi is: [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'b1668072-a83a-4a97-b60d-54f1d0a5a421', 'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'mac_address': 'fa:16:3e:05:96:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 541, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:40Z', 'updated_at': '2021-05-28T14:30:45Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'subnets': [{'id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:30:46.336392 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Network 69506df2-d621-488b-81b1-55216d075161 is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:30:46.479822 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, 69506df2-d621-488b-81b1-55216d075161) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:46.495503 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7185159e-8e57-4059-9695-39afff532b71 None None] Network 69506df2-d621-488b-81b1-55216d075161 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:30:46.496042 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:46.496042 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:46.684055 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38440) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:46.686830 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 844 time: 1.5199187
May 28 14:30:46.694584 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:46.700181 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:46.716771 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Usage tracker for resource:router and tenant:c8294323eb2a41b6875b41f3ee440d11 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:46.721180 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:46.728311 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:46.749028 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-69506df2-d621-488b-81b1-55216d075161', 'network_id': '69506df2-d621-488b-81b1-55216d075161', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'fixed_ips': [{'subnet_id': 'e680abde-f402-47b8-b002-0b0e1d84f679'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:30:46.749946 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:46.846823 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:46.847976 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:46.870448 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:46.928043 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Allocated IP 172.20.0.2 (69506df2-d621-488b-81b1-55216d075161/e680abde-f402-47b8-b002-0b0e1d84f679/f9b4260c-0936-47d8-82c5-881b618de08a) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:30:47.156247 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device b1668072-a83a-4a97-b60d-54f1d0a5a421 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:47.211618 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:47.236507 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Transition to ACTIVE for port object f9b4260c-0936-47d8-82c5-881b618de08a will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:47.267934 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Transition to ACTIVE for port object f9b4260c-0936-47d8-82c5-881b618de08a will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:47.400183 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:47.413425 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:47.486566 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port b1668072-a83a-4a97-b60d-54f1d0a5a421 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:47.509411 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Network 69506df2-d621-488b-81b1-55216d075161 is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:30:47.526105 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port b1668072-a83a-4a97-b60d-54f1d0a5a421 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:47.526789 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:47.562863 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:47.570277 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:47.581555 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:30:47.590768 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-628d0ddf-2a5d-4d5c-a285-5e035694e275 req-bf682002-e955-4cf6-9edc-1d9e8738ff76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:47.592698 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-628d0ddf-2a5d-4d5c-a285-5e035694e275 req-bf682002-e955-4cf6-9edc-1d9e8738ff76 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.5808899
May 28 14:30:47.692535 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Pushing event updated for resources: {'Port': ['ID=f9b4260c-0936-47d8-82c5-881b618de08a,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:47.701327 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.288s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:47.720460 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Attempting to bind port f9b4260c-0936-47d8-82c5-881b618de08a on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:30:47.721446 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Attempting to bind port f9b4260c-0936-47d8-82c5-881b618de08a by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': 'f0502c45-65a2-4857-a8a8-8ecc114c3345', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '69506df2-d621-488b-81b1-55216d075161'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:30:47.721836 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Attempting to bind port f9b4260c-0936-47d8-82c5-881b618de08a on network 69506df2-d621-488b-81b1-55216d075161 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:30:47.731784 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-628d0ddf-2a5d-4d5c-a285-5e035694e275 req-8d35e82c-2cd7-4fe1-9caa-e715c1f26f2c tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1269553
May 28 14:30:47.732384 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 30, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:30:47.732769 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Checking segment: {'id': 'f0502c45-65a2-4857-a8a8-8ecc114c3345', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '69506df2-d621-488b-81b1-55216d075161'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:30:47.733180 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:47.733580 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Bound using segment: {'id': 'f0502c45-65a2-4857-a8a8-8ecc114c3345', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '69506df2-d621-488b-81b1-55216d075161'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:30:47.734068 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Bound port: f9b4260c-0936-47d8-82c5-881b618de08a, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0502c45-65a2-4857-a8a8-8ecc114c3345', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '69506df2-d621-488b-81b1-55216d075161'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:30:47.734451 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:47.859444 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-2104bc5d-c276-4bd8-b1c6-774220fbd9a2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:47.861190 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-2104bc5d-c276-4bd8-b1c6-774220fbd9a2 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.2254963
May 28 14:30:47.888746 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:47.900657 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] For port f9b4260c-0936-47d8-82c5-881b618de08a, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:30:47.917709 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] For port f9b4260c-0936-47d8-82c5-881b618de08a, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f9b4260c-0936-47d8-82c5-881b618de08a,segment=NetworkSegment(f0502c45-65a2-4857-a8a8-8ecc114c3345),segment_id=f0502c45-65a2-4857-a8a8-8ecc114c3345)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:30:47.931972 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port b1668072-a83a-4a97-b60d-54f1d0a5a421, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=b1668072-a83a-4a97-b60d-54f1d0a5a421,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:48.057653 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:48.063773 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:48.109932 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:48.159317 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Pushing event updated for resources: {'Port': ['ID=f9b4260c-0936-47d8-82c5-881b618de08a,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:48.168266 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:48.169131 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.050s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:48.248148 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Deleting port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:30:48.248649 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:48.259363 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=b1668072-a83a-4a97-b60d-54f1d0a5a421,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:48.263603 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:48.365722 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:48.404374 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:48.571474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] For port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,segment=NetworkSegment(f9da76d7-4098-4417-923d-48d74a246b67),segment_id=f9da76d7-4098-4417-923d-48d74a246b67)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:48.571862 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:48.749148 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Calling delete_port for 965a8c13-7f18-4e6d-92f2-16c7c866bcfd owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:30:48.808556 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Allocated IP 172.27.3.86 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/9d1eb889-320f-4f14-a650-410e2b77cc8e) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:30:49.016665 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70210982-73e4-466a-9351-479ca0a92b98 req-6c062302-94f5-48b8-b918-ba95c0709a94 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:49.019487 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-70210982-73e4-466a-9351-479ca0a92b98 req-6c062302-94f5-48b8-b918-ba95c0709a94 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 945 time: 0.0954318
May 28 14:30:49.067110 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:49.134419 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-70210982-73e4-466a-9351-479ca0a92b98 req-5d936ffc-34c5-424e-957f-7abca3cd040e tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/security-groups?id=b43869d5-cbfc-463d-bbd2-01c0f44737b1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1055865
May 28 14:30:49.141007 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:49.150486 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:49.202662 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Pushing event deleted for resources: {'Port': ['ID=965a8c13-7f18-4e6d-92f2-16c7c866bcfd,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:49.209437 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:49.213794 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:49.214392 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:49.295479 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f9b4260c-0936-47d8-82c5-881b618de08a up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:49.408734 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:30:49.410063 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:49.431241 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:30:49.536371 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port f9b4260c-0936-47d8-82c5-881b618de08a completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:49.542920 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device b1668072-a83a-4a97-b60d-54f1d0a5a421 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:49.580947 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5693a504-1ca2-4fe5-857b-1b6885918fca None None] Network 69506df2-d621-488b-81b1-55216d075161 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:30:49.592058 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] No DVR routers for this DVR port 965a8c13-7f18-4e6d-92f2-16c7c866bcfd on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:30:49.602074 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:49.604746 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3eac2abf-26a1-4d1d-84ed-ac16a83ef646', 'name': 'network-vif-deleted', 'tag': '965a8c13-7f18-4e6d-92f2-16c7c866bcfd'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:30:49.612481 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Pushing event updated for resources: {'Port': ['ID=9d1eb889-320f-4f14-a650-410e2b77cc8e,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:49.626400 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.411s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:49.697591 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3eac2abf-26a1-4d1d-84ed-ac16a83ef646', 'name': 'network-vif-deleted', 'tag': '965a8c13-7f18-4e6d-92f2-16c7c866bcfd', 'status': 'completed', 'code': 200}
May 28 14:30:49.704394 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5e060d7b-b66e-41c5-84ce-044a037ba881 req-95b770da-e539-4081-93a2-1e8ebedcafad tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.90 "DELETE /v2.0/ports/965a8c13-7f18-4e6d-92f2-16c7c866bcfd HTTP/1.1" status: 204  len: 173 time: 1.8364041
May 28 14:30:49.789774 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port b1668072-a83a-4a97-b60d-54f1d0a5a421 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:49.790145 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:49.825309 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-4306e0b0-923c-4d90-9607-1dfd619570e0 None None] Provisioning for port f9b4260c-0936-47d8-82c5-881b618de08a completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:49.847491 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-4306e0b0-923c-4d90-9607-1dfd619570e0 None None] Provisioning complete for port f9b4260c-0936-47d8-82c5-881b618de08a triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:49.847986 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4306e0b0-923c-4d90-9607-1dfd619570e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:50.086790 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4306e0b0-923c-4d90-9607-1dfd619570e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:50.121206 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-4306e0b0-923c-4d90-9607-1dfd619570e0 None None] For port f9b4260c-0936-47d8-82c5-881b618de08a, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f9b4260c-0936-47d8-82c5-881b618de08a,segment=NetworkSegment(f0502c45-65a2-4857-a8a8-8ecc114c3345),segment_id=f0502c45-65a2-4857-a8a8-8ecc114c3345)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:50.145267 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:50.199815 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4306e0b0-923c-4d90-9607-1dfd619570e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:50.203830 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-fb8bab08-b956-4625-921d-7dfeed11115b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:50.304336 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4306e0b0-923c-4d90-9607-1dfd619570e0 None None] Pushing event updated for resources: {'Port': ['ID=f9b4260c-0936-47d8-82c5-881b618de08a,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:50.307802 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-4306e0b0-923c-4d90-9607-1dfd619570e0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:50.397735 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c req-e3d58abc-8e6a-45bb-912c-fd564d2f0659 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Synchronizing usage tracker for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:30:50.441354 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a12278f7-8239-4e58-a749-2623c45ccc9c None None] Provisioning complete for port f9b4260c-0936-47d8-82c5-881b618de08a triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:50.441354 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a12278f7-8239-4e58-a749-2623c45ccc9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:50.495957 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c req-e3d58abc-8e6a-45bb-912c-fd564d2f0659 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Unset dirty status for tenant:94dc9f7ad5dd40429991c68c00e7ec6d on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:30:50.497070 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f60c1951-11f9-4ee0-a25f-92a1f88f0f3c req-e3d58abc-8e6a-45bb-912c-fd564d2f0659 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] 10.222.0.59 "GET /v2.0/ports?device_id=3eac2abf-26a1-4d1d-84ed-ac16a83ef646 HTTP/1.1" status: 200  len: 210 time: 0.1487041
May 28 14:30:50.632458 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:50.936898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92695) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:30:51.037923 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 965a8c13-7f18-4e6d-92f2-16c7c866bcfd no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:30:51.065595 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f9b4260c-0936-47d8-82c5-881b618de08a up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:51.115238 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 965a8c13-7f18-4e6d-92f2-16c7c866bcfd {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:30:51.115677 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 965a8c13-7f18-4e6d-92f2-16c7c866bcfd not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:30:51.122391 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:30:51.136658 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Sync routers for ids ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:30:51.152781 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Routers {'0380fcc5-9edc-4ff3-a388-0ab4421ac662'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:51.153412 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba26f7460>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:51.205093 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:51.209105 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 919 time: 4.5212486
May 28 14:30:51.209266 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port f9b4260c-0936-47d8-82c5-881b618de08a triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:51.209266 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:51.209449 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38470) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:51.411282 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Set router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:51.655162 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38480) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:51.746200 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-5279e11b-f9cc-4f5e-a14f-2853686af620 admin admin] Deleting subnet a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:30:51.754023 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5279e11b-f9cc-4f5e-a14f-2853686af620 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:51.757322 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba26f7460>, [{'id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:46Z', 'updated_at': '2021-05-28T14:30:49Z', 'revision_number': 3, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'gw_port': {'id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:48Z', 'updated_at': '2021-05-28T14:30:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:51.761727 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Checking router: 0380fcc5-9edc-4ff3-a388-0ab4421ac662 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:30:51.762089 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Updating router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 port 9d1eb889-320f-4f14-a650-410e2b77cc8e binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:30:51.822011 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5279e11b-f9cc-4f5e-a14f-2853686af620 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1610776'] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:51.888160 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:51.967869 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.008213 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5279e11b-f9cc-4f5e-a14f-2853686af620 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.199510 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Allocated IP 172.20.0.1 (69506df2-d621-488b-81b1-55216d075161/e680abde-f402-47b8-b002-0b0e1d84f679/7aa04697-2281-4622-afa7-1e7ddb397354) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:30:52.306718 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.439264 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Transition to ACTIVE for port object 9d1eb889-320f-4f14-a650-410e2b77cc8e will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:52.440343 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5279e11b-f9cc-4f5e-a14f-2853686af620 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1635750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1808149'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.445632 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-73a6af08-c0ff-4e14-8d48-e192813e713c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:52.480287 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5279e11b-f9cc-4f5e-a14f-2853686af620 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:52.482209 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5279e11b-f9cc-4f5e-a14f-2853686af620 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.488979 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5279e11b-f9cc-4f5e-a14f-2853686af620 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:52.493057 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5279e11b-f9cc-4f5e-a14f-2853686af620 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/a6362a01-1b2c-42b0-9c38-8dfc7ad7e08e HTTP/1.1" status: 204  len: 168 time: 0.8336661
May 28 14:30:52.496255 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38486) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:52.503615 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.517138 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a req-2d578236-d2a9-4317-a7d7-70a51a49e8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:52.518611 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a req-2d578236-d2a9-4317-a7d7-70a51a49e8b4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 946 time: 0.2399919
May 28 14:30:52.522570 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.529268 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:52.531660 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.provisioning_blocks [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Transition to ACTIVE for port object 7aa04697-2281-4622-afa7-1e7ddb397354 will not be triggered until provisioned by entity DHCP. {{(pid=92694) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:52.588257 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3376dfd4-9d77-448d-8060-fef1f5ab5e2a req-3535ccbe-dbda-42d8-9fb8-83795caaa5de tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0603609
May 28 14:30:52.607946 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.617499 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Attempting to bind port 9d1eb889-320f-4f14-a650-410e2b77cc8e on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:30:52.617964 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Attempting to bind port 9d1eb889-320f-4f14-a650-410e2b77cc8e by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:30:52.618371 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Attempting to bind port 9d1eb889-320f-4f14-a650-410e2b77cc8e on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:30:52.627755 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 30, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:30:52.632441 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:30:52.632441 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.632441 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:30:52.632441 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Bound port: 9d1eb889-320f-4f14-a650-410e2b77cc8e, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:30:52.632441 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.655971 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ae324e-a80c-46f1-861e-7eb4d28c3ab3 None None] Pushing event updated for resources: {'Port': ['ID=9d1eb889-320f-4f14-a650-410e2b77cc8e,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:52.663009 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-91ae324e-a80c-46f1-861e-7eb4d28c3ab3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:52.685601 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.690277 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:52.710088 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] For port 9d1eb889-320f-4f14-a650-410e2b77cc8e, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:30:52.713462 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] For port 9d1eb889-320f-4f14-a650-410e2b77cc8e, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=9d1eb889-320f-4f14-a650-410e2b77cc8e,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:30:52.739065 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.751966 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba200a100>,) {'filters': {'network_id': ['37e18bf5-545d-49a2-afdf-585587a7907f']}} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:52.758238 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Network 69506df2-d621-488b-81b1-55216d075161 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:30:52.761128 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:52.764681 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:30:52.767409 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba200a100>, 'f9da76d7-4098-4417-923d-48d74a246b67') {'for_net_delete': True} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:52.768249 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba200a100>, 'f9da76d7-4098-4417-923d-48d74a246b67') {} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:52.782696 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1610771'] for segment, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.798813 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Pushing event updated for resources: {'Port': ['ID=7aa04697-2281-4622-afa7-1e7ddb397354,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:52.801144 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.803144 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:52.811148 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Releasing vlan 851 on physical network physnet1 to pool {{(pid=92695) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:30:52.811148 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1697792'] for segment, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.812927 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.818792 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]: Traceback (most recent call last):
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     timer()
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     cb(*args, **kw)
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     return func(*args, **kwargs)
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     self._notify()
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     self.callback(batched_events)
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     event.method(event)
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     return f(self, *a, **k)
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._get(url).json()
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self.request(url, 'GET', **kwargs)
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:30:52.832665 dv-cinder-791281-3-iscsi neutron-server[92695]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:30:52.838879 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.895675 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Routers {'0380fcc5-9edc-4ff3-a388-0ab4421ac662'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:52.896315 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba26f7460>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:52.956089 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ae324e-a80c-46f1-861e-7eb4d28c3ab3 None None] Pushing event updated for resources: {'Port': ['ID=9d1eb889-320f-4f14-a650-410e2b77cc8e,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:52.966213 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-91ae324e-a80c-46f1-861e-7eb4d28c3ab3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:52.993829 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:52.998210 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:53.015505 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:53.026332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Pushing event deleted for resources: {'Network': ['ID=37e18bf5-545d-49a2-afdf-585587a7907f,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:53.029614 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:53.085617 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:53.090168 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] Set router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:53.100320 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-db42079e-b44e-40af-98d4-ad0d3a54abde admin admin] 10.222.0.59 "DELETE /v2.0/networks/37e18bf5-545d-49a2-afdf-585587a7907f HTTP/1.1" status: 204  len: 168 time: 0.6038222
May 28 14:30:53.215669 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-3857a4c4-f91e-40e5-8652-5b8eb0f8b8d2 None None] Provisioning for port 7aa04697-2281-4622-afa7-1e7ddb397354 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:53.227074 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-3857a4c4-f91e-40e5-8652-5b8eb0f8b8d2 None None] Provisioning complete for port 7aa04697-2281-4622-afa7-1e7ddb397354 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:53.228534 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3857a4c4-f91e-40e5-8652-5b8eb0f8b8d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:53.311963 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:53.354472 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-3857a4c4-f91e-40e5-8652-5b8eb0f8b8d2 None None] Port 7aa04697-2281-4622-afa7-1e7ddb397354 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:30:53.427754 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:53.436694 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba26f7460>, [{'id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:46Z', 'updated_at': '2021-05-28T14:30:49Z', 'revision_number': 3, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'gw_port': {'id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:48Z', 'updated_at': '2021-05-28T14:30:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:53.441711 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3df9c132-18a0-47f7-91eb-df0c42b0f9dc None None] The sync data for ids ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'] in dv-cinder-791281-3-iscsi is: [{'id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:46Z', 'updated_at': '2021-05-28T14:30:49Z', 'revision_number': 3, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'gw_port': {'id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:48Z', 'updated_at': '2021-05-28T14:30:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:30:53.459756 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2bf78355-a0c2-401c-b25c-0cbe35109d65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:53.538876 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38492) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:53.541245 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:53.544721 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Pushing event updated for resources: {'Port': ['ID=7aa04697-2281-4622-afa7-1e7ddb397354,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:53.548419 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:53.592224 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-dbc0bd0c-aae9-4613-b299-53dc7b449150 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=94dc9f7ad5dd40429991c68c00e7ec6d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0521092
May 28 14:30:53.594863 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38496) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:53.681978 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7fae4ee9-e436-4244-b0b1-0eef2590f78c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:53.716546 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Network 69506df2-d621-488b-81b1-55216d075161 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:30:53.717684 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:30:53.726380 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7fae4ee9-e436-4244-b0b1-0eef2590f78c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:53.887507 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9a7916-52fd-42f0-9986-3a22951c952c req-2b4c02ad-6b66-40a0-b599-e0b727df28c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:53.892091 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6b9a7916-52fd-42f0-9986-3a22951c952c req-2b4c02ad-6b66-40a0-b599-e0b727df28c3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 946 time: 0.1429849
May 28 14:30:53.959138 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6b9a7916-52fd-42f0-9986-3a22951c952c req-66a12520-a18c-497f-8ddf-87f9ab7986c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0632939
May 28 14:30:53.972550 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:30:53.976160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7fae4ee9-e436-4244-b0b1-0eef2590f78c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:53.980142 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f56d4c26-3193-4b8b-a612-3e92b6149a46 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:53.995332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fae4ee9-e436-4244-b0b1-0eef2590f78c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b43869d5-cbfc-463d-bbd2-01c0f44737b1,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:53.998223 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-7fae4ee9-e436-4244-b0b1-0eef2590f78c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:54.078564 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-85ef1b33-d944-4dcd-a9d9-9315789e2256 None None] Provisioning complete for port 7aa04697-2281-4622-afa7-1e7ddb397354 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:54.078939 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-85ef1b33-d944-4dcd-a9d9-9315789e2256 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:54.090332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7fae4ee9-e436-4244-b0b1-0eef2590f78c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:54.094855 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-7fae4ee9-e436-4244-b0b1-0eef2590f78c admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b43869d5-cbfc-463d-bbd2-01c0f44737b1 HTTP/1.1" status: 204  len: 168 time: 0.4990549
May 28 14:30:54.136790 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-85ef1b33-d944-4dcd-a9d9-9315789e2256 None None] Port 7aa04697-2281-4622-afa7-1e7ddb397354 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:30:54.192897 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:30:54.207190 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] 10.222.0.59 "PUT /v2.0/routers/0380fcc5-9edc-4ff3-a388-0ab4421ac662/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9962673
May 28 14:30:54.271122 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-b1cf5599-dde2-406f-beac-6581313f3c27 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:54.277531 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-b1cf5599-dde2-406f-beac-6581313f3c27 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 946 time: 0.1037960
May 28 14:30:54.426056 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Deleting port c2872b93-4077-4bc0-8619-140f73de2a3a {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:30:54.426312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:54.576811 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] For port c2872b93-4077-4bc0-8619-140f73de2a3a, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c2872b93-4077-4bc0-8619-140f73de2a3a,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:54.576811 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:54.953272 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38520) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:54.959179 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1469735783', 'description': 'tempest-secgroup-smoke-1469735783 description', 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:54.972785 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:54.979623 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Usage tracker for resource:security_group and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:54.985797 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:54.993569 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:54.993940 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:54.994294 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.l3_db [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Floating IP b83e86bc-99fc-48f9-9a53-cdd2efc8a060 disassociated. External IP: 172.27.3.190, port: c2872b93-4077-4bc0-8619-140f73de2a3a.
May 28 14:30:54.994627 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling delete_port for c2872b93-4077-4bc0-8619-140f73de2a3a owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:30:54.997193 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:55.093239 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.117367 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 9d1eb889-320f-4f14-a650-410e2b77cc8e up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:55.144098 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:55.189123 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Usage tracker for resource:security_group_rule and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:55.200693 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:55.210471 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:55.266996 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Sync routers for ids ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:30:55.276974 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Routers {'0380fcc5-9edc-4ff3-a388-0ab4421ac662'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:55.277241 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 req-dd8616cf-4a7b-4997-85c5-6362c3a157ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:30:55.277575 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba25c10a0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:55.278681 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 req-dd8616cf-4a7b-4997-85c5-6362c3a157ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 946 time: 0.1365273
May 28 14:30:55.317865 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 9d1eb889-320f-4f14-a650-410e2b77cc8e completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:55.324164 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 9d1eb889-320f-4f14-a650-410e2b77cc8e triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:55.324736 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.324878 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.333922 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-d15ccb09-d7a3-4fb3-ba68-881559b35bf4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:55.372878 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.391161 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event deleted for resources: {'Port': ['ID=c2872b93-4077-4bc0-8619-140f73de2a3a,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:55.399306 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:55.415000 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1bd5c3d1-b7a5-4624-9f61-af76fcde6d24 req-84b82616-de99-485c-b9e6-36de2b693d78 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=d2a399b1-c1b2-4892-8b44-28943526ac96&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1282446
May 28 14:30:55.485379 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.496791 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-80fec171-eb5d-4de6-8081-b7cd12dbc9b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:55.498197 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.503169 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Set router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:55.516951 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 9d1eb889-320f-4f14-a650-410e2b77cc8e, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=9d1eb889-320f-4f14-a650-410e2b77cc8e,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:55.617177 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9ab39ed0-1a7b-48aa-865b-cdecc297916b,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:55.622882 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.625584 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-4d993a95-75a9-4fa9-b8c4-2dac01f20e7c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:55.631270 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:55.670128 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Router 93611a0c-a5d3-438a-bf94-7453623f231d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:30:55.681162 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.682663 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.7284334
May 28 14:30:55.686107 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38538) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:55.693391 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Request body: {'security_group_rule': {'security_group_id': '9ab39ed0-1a7b-48aa-865b-cdecc297916b', 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:55.704678 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:55.714889 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Usage tracker for resource:security_group_rule and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:55.721500 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:55.735086 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:55.742133 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=9d1eb889-320f-4f14-a650-410e2b77cc8e,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:55.757857 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.758208 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.758546 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.758880 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.759208 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.759536 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.760099 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.760237 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.760517 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.760839 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.761222 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.761508 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:30:55.778427 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:55.843917 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.889093 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:30:55.899418 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] Sync routers for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:30:55.921165 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:55.921539 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:55.923729 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba272c5b0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:55.994874 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba25c10a0>, [{'id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:46Z', 'updated_at': '2021-05-28T14:30:52Z', 'revision_number': 4, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'gw_port': {'id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:a4:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:48Z', 'updated_at': '2021-05-28T14:30:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '7aa04697-2281-4622-afa7-1e7ddb397354', 'name': '', 'network_id': '69506df2-d621-488b-81b1-55216d075161', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'mac_address': 'fa:16:3e:b7:55:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_interface', 'standard_attr_id': 553, 'fixed_ips': [{'subnet_id': 'e680abde-f402-47b8-b002-0b0e1d84f679', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:52Z', 'updated_at': '2021-05-28T14:30:53Z', 'revision_number': 2, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'subnets': [{'id': 'e680abde-f402-47b8-b002-0b0e1d84f679', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:55.996506 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] No DVR routers for this DVR port c2872b93-4077-4bc0-8619-140f73de2a3a on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:30:55.999514 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.000046 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Checking router: 0380fcc5-9edc-4ff3-a388-0ab4421ac662 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:30:56.000493 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Updating router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 port 7aa04697-2281-4622-afa7-1e7ddb397354 binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:30:56.002068 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c1540bae-97eb-46f6-9ef9-d48cf4e57545 req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "DELETE /v2.0/ports/c2872b93-4077-4bc0-8619-140f73de2a3a HTTP/1.1" status: 204  len: 173 time: 1.7234969
May 28 14:30:56.003294 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-deleted', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:30:56.007906 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.010336 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:56.036209 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=855162d7-b502-4839-82a3-5c1e49552ece,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:56.041976 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:56.070865 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.082585 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c36e73b-e6ab-4203-ada8-e971693460e2', 'name': 'network-vif-deleted', 'tag': 'c2872b93-4077-4bc0-8619-140f73de2a3a', 'status': 'completed', 'code': 200}
May 28 14:30:56.182344 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:56.185034 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.186457 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6697a89e-e53b-447a-9fab-784eecd7cb20 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4991267
May 28 14:30:56.189411 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38544) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:56.195514 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Request body: {'security_group_rule': {'security_group_id': '9ab39ed0-1a7b-48aa-865b-cdecc297916b', 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:56.202252 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:56.206263 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Usage tracker for resource:security_group_rule and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:56.209814 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:56.215472 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:56.304218 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.445553 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.460229 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.476659 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Transition to ACTIVE for port object 7aa04697-2281-4622-afa7-1e7ddb397354 will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:30:56.562892 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.565186 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:56.598544 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.609739 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:56.657242 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b54a4546-332b-4787-8a3e-dc1e36c7183d,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:56.667246 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-ae81db21-5bdf-492d-94f9-61c6ef49e19c req-c424e002-54e8-414a-8049-2b37919efc18 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Synchronizing usage tracker for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:30:56.670964 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba272c5b0>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:56.672597 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:56.686913 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] Checking router: 93611a0c-a5d3-438a-bf94-7453623f231d for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:30:56.694992 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:56.695931 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba272c5b0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:56.768125 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.769460 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.5782585
May 28 14:30:56.772352 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38552) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:56.778873 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Request body: {'security_group_rule': {'security_group_id': '9ab39ed0-1a7b-48aa-865b-cdecc297916b', 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:56.788598 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:56.796815 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Usage tracker for resource:security_group_rule and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:56.805155 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:56.818283 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:56.838606 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-ae81db21-5bdf-492d-94f9-61c6ef49e19c req-c424e002-54e8-414a-8049-2b37919efc18 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Unset dirty status for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:30:56.839798 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ae81db21-5bdf-492d-94f9-61c6ef49e19c req-c424e002-54e8-414a-8049-2b37919efc18 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=2c36e73b-e6ab-4203-ada8-e971693460e2 HTTP/1.1" status: 200  len: 210 time: 0.2640555
May 28 14:30:56.850009 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd8f0f0-64f7-4b49-8301-9e8f9a99b194 None None] Pushing event updated for resources: {'Port': ['ID=7aa04697-2281-4622-afa7-1e7ddb397354,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:56.895412 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-2dd8f0f0-64f7-4b49-8301-9e8f9a99b194 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.290s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:56.934330 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Attempting to bind port 7aa04697-2281-4622-afa7-1e7ddb397354 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:30:56.934709 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Attempting to bind port 7aa04697-2281-4622-afa7-1e7ddb397354 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': 'f0502c45-65a2-4857-a8a8-8ecc114c3345', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '69506df2-d621-488b-81b1-55216d075161'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:30:56.935073 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Attempting to bind port 7aa04697-2281-4622-afa7-1e7ddb397354 on network 69506df2-d621-488b-81b1-55216d075161 {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:30:56.942434 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 30, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:30:56.942810 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Checking segment: {'id': 'f0502c45-65a2-4857-a8a8-8ecc114c3345', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '69506df2-d621-488b-81b1-55216d075161'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:30:56.943212 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.943896 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Bound using segment: {'id': 'f0502c45-65a2-4857-a8a8-8ecc114c3345', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '69506df2-d621-488b-81b1-55216d075161'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:30:56.944177 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Bound port: 7aa04697-2281-4622-afa7-1e7ddb397354, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0502c45-65a2-4857-a8a8-8ecc114c3345', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '69506df2-d621-488b-81b1-55216d075161'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:30:56.944562 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.958533 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:56.992903 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:57.058204 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.066037 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] For port 7aa04697-2281-4622-afa7-1e7ddb397354, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:30:57.073472 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] For port 7aa04697-2281-4622-afa7-1e7ddb397354, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=7aa04697-2281-4622-afa7-1e7ddb397354,segment=NetworkSegment(f0502c45-65a2-4857-a8a8-8ecc114c3345),segment_id=f0502c45-65a2-4857-a8a8-8ecc114c3345)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:30:57.088497 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:30:57.124181 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 9d1eb889-320f-4f14-a650-410e2b77cc8e up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:57.142062 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.145283 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-073c0cb1-30cc-43fb-9d4a-bab1787b853b tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:57.169804 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: c2872b93-4077-4bc0-8619-140f73de2a3a {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:30:57.170151 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c2872b93-4077-4bc0-8619-140f73de2a3a not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:30:57.181608 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=85493180-d005-4b78-aeb3-395e6539446a,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:57.192914 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:57.231455 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.235355 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:57.307832 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Routers {'0380fcc5-9edc-4ff3-a388-0ab4421ac662'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:30:57.308468 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba25c10a0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:30:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:57.373976 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 9d1eb889-320f-4f14-a650-410e2b77cc8e triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:57.374547 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.401230 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd8f0f0-64f7-4b49-8301-9e8f9a99b194 None None] Pushing event updated for resources: {'Port': ['ID=7aa04697-2281-4622-afa7-1e7ddb397354,revision_number=4']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:57.405957 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-2dd8f0f0-64f7-4b49-8301-9e8f9a99b194 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:57.425611 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.431226 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38560) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:57.435209 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-a5033dca-f44c-4d40-a69f-1ba59999d8d0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.6617889
May 28 14:30:57.440211 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Request body: {'security_group_rule': {'security_group_id': '9ab39ed0-1a7b-48aa-865b-cdecc297916b', 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:57.458973 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:57.467749 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Usage tracker for resource:security_group_rule and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:57.474902 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:57.492104 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:57.534987 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] Set router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:30:57.633763 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.636219 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba272c5b0>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:57.642373 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c43a0115-e760-4da1-902d-48cd6e3d561e None None] The sync data for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi is: [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:30:57.718889 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.819351 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.821899 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:57.853615 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ad4bf8bf-a49f-4b25-ad7d-a7c2c0916ddd,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:57.862180 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:57.885785 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba25c10a0>, [{'id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:46Z', 'updated_at': '2021-05-28T14:30:52Z', 'revision_number': 4, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'gw_port': {'id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:a4:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:48Z', 'updated_at': '2021-05-28T14:30:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '7aa04697-2281-4622-afa7-1e7ddb397354', 'name': '', 'network_id': '69506df2-d621-488b-81b1-55216d075161', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'mac_address': 'fa:16:3e:b7:55:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_interface', 'standard_attr_id': 553, 'fixed_ips': [{'subnet_id': 'e680abde-f402-47b8-b002-0b0e1d84f679', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:52Z', 'updated_at': '2021-05-28T14:30:57Z', 'revision_number': 4, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'subnets': [{'id': 'e680abde-f402-47b8-b002-0b0e1d84f679', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:30:57.890539 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2eb961b-7093-45f1-b77b-8f482f1f71da None None] The sync data for ids ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'] in dv-cinder-791281-3-iscsi is: [{'id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:46Z', 'updated_at': '2021-05-28T14:30:52Z', 'revision_number': 4, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'gw_port': {'id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:a4:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:48Z', 'updated_at': '2021-05-28T14:30:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '7aa04697-2281-4622-afa7-1e7ddb397354', 'name': '', 'network_id': '69506df2-d621-488b-81b1-55216d075161', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'mac_address': 'fa:16:3e:b7:55:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_interface', 'standard_attr_id': 553, 'fixed_ips': [{'subnet_id': 'e680abde-f402-47b8-b002-0b0e1d84f679', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:52Z', 'updated_at': '2021-05-28T14:30:57Z', 'revision_number': 4, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'subnets': [{'id': 'e680abde-f402-47b8-b002-0b0e1d84f679', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:30:57.956206 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.966793 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:57.966793 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.5304599
May 28 14:30:57.969356 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38568) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:57.982048 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Request body: {'security_group_rule': {'security_group_id': '9ab39ed0-1a7b-48aa-865b-cdecc297916b', 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:57.997140 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:57.999822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Usage tracker for resource:security_group_rule and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:58.002905 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:58.009116 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:58.048683 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ec3a60-40b0-46e6-b963-34d61792a177 None None] New status for floating IP b83e86bc-99fc-48f9-9a53-cdd2efc8a060: DOWN {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:30:58.136935 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.securitygroups_db [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Project 26daec94fed843c8b74a9ff7d18ecdb5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 28 14:30:58.143394 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.218957 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38576) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:58.226700 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.296564 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ffa75ee8-e394-4d7b-bda7-662951013a51 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.316520 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.319453 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:58.326580 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ffa75ee8-e394-4d7b-bda7-662951013a51 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.348270 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aa9c72b8-53b4-4b99-b5e4-52f0da896a6c,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:58.355849 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:58.439312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.440818 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-03ff27e9-13fb-4e3e-a8c1-77c084936abc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.4634891
May 28 14:30:58.443543 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38580) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:58.448822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Request body: {'security_group_rule': {'security_group_id': '9ab39ed0-1a7b-48aa-865b-cdecc297916b', 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:30:58.464133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:30:58.464133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Usage tracker for resource:security_group_rule and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:30:58.464133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:30:58.469635 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:30:58.482248 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ffa75ee8-e394-4d7b-bda7-662951013a51 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.486495 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-02938388-ebdd-423a-854e-95afd6136416 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:58.503663 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffa75ee8-e394-4d7b-bda7-662951013a51 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2a399b1-c1b2-4892-8b44-28943526ac96,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:58.506700 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ffa75ee8-e394-4d7b-bda7-662951013a51 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:58.545055 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.securitygroups_db [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Project 26daec94fed843c8b74a9ff7d18ecdb5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 28 14:30:58.552165 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.583225 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ffa75ee8-e394-4d7b-bda7-662951013a51 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.584654 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-ffa75ee8-e394-4d7b-bda7-662951013a51 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /v2.0/security-groups/d2a399b1-c1b2-4892-8b44-28943526ac96 HTTP/1.1" status: 204  len: 168 time: 0.3646061
May 28 14:30:58.587293 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38584) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:58.606428 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.api.v2.resource [None req-c37948fa-af70-4d1f-82ea-9b9df923e9ed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] show failed (client error): The resource could not be found.
May 28 14:30:58.607458 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-c37948fa-af70-4d1f-82ea-9b9df923e9ed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups/d2a399b1-c1b2-4892-8b44-28943526ac96 HTTP/1.1" status: 404  len: 347 time: 0.0190475
May 28 14:30:58.610486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38588) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:30:58.630443 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.696882 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.710065 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:58.743007 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a3a83e23-8ae7-4f00-9a9d-bf72779cc963,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:58.746064 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:58.827948 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:58.829652 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c3433f57-1d89-44c7-b679-67d5c46fcc78 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.3848326
May 28 14:30:58.951548 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Deleting port ddf95fa8-cae5-47b8-8630-d2ca2c5d1d3f {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:30:58.952010 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:59.093402 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:59.093714 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:59.141453 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 7aa04697-2281-4622-afa7-1e7ddb397354 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:30:59.252740 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling delete_port for ddf95fa8-cae5-47b8-8630-d2ca2c5d1d3f owned by network:floatingip {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:30:59.311451 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 7aa04697-2281-4622-afa7-1e7ddb397354 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:30:59.317661 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 7aa04697-2281-4622-afa7-1e7ddb397354 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:30:59.317661 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:59.476515 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:59.496403 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:59.502837 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:59.511810 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 7aa04697-2281-4622-afa7-1e7ddb397354, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=7aa04697-2281-4622-afa7-1e7ddb397354,segment=NetworkSegment(f0502c45-65a2-4857-a8a8-8ecc114c3345),segment_id=f0502c45-65a2-4857-a8a8-8ecc114c3345)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:30:59.547526 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event deleted for resources: {'Port': ['ID=ddf95fa8-cae5-47b8-8630-d2ca2c5d1d3f,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:59.574171 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:59.631005 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:59.634262 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:30:59.640545 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:59.704511 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=7aa04697-2281-4622-afa7-1e7ddb397354,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:30:59.708131 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:30:59.722422 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:30:59.723689 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /v2.0/floatingips/b83e86bc-99fc-48f9-9a53-cdd2efc8a060 HTTP/1.1" status: 204  len: 168 time: 1.1114590
May 28 14:31:00.049673 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-84c5caf2-bcf0-4ae0-b2a1-9aabb929f2a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:00.183129 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38646) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:00.188649 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'security_group': {'name': 'tempest-securitygroup--97907957', 'description': 'tempest-description--1895401744'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:00.195120 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:00.200157 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:security_group and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:00.203169 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:00.210142 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:00.302112 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:00.323629 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:00.327831 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:security_group_rule and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:00.331400 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:00.337308 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:00.407941 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:00.524945 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:00.530378 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5cc31eb1-11ec-4dd5-ae31-74ab97888f1b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:00.572155 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ab91613c-a89d-4274-9712-4be0d63eeb3e,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:00.575588 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:00.665317 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:00.666598 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.4823017
May 28 14:31:00.669413 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38666) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:00.674971 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'security_group_rule': {'security_group_id': 'ab91613c-a89d-4274-9712-4be0d63eeb3e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:00.680813 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:00.684823 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:security_group_rule and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:00.687681 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:00.694013 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:00.800219 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:00.865112 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:00.947631 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:00.953992 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4c678821-ee31-4fe9-b294-184565fa0b06 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:00.973873 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ea983d62-6620-48df-917c-27c7d2a73876,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:00.976424 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:01.045283 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:01.048854 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3758595
May 28 14:31:01.049017 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38674) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:01.054809 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'security_group_rule': {'security_group_id': 'ab91613c-a89d-4274-9712-4be0d63eeb3e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:01.060865 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:01.065856 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:security_group_rule and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:01.069172 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:01.071823 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 7aa04697-2281-4622-afa7-1e7ddb397354 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:31:01.078961 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:01.146744 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 7aa04697-2281-4622-afa7-1e7ddb397354 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:31:01.147117 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:01.156819 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:01.225570 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:01.342544 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:01.344575 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:01.367369 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e9072884-ae16-4237-8d05-5a76850cd571,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:01.369810 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:01.476480 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:01.477699 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-3f52b7e6-5dfb-46a9-8793-1cb61a6a199b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4277067
May 28 14:31:01.480876 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38680) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:01.485991 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'floatingip': {'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:01.491976 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:01.495916 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Usage tracker for resource:floatingip and tenant:3bbdb80ac64d4db395d276876322e7b0 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:01.498955 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:01.504919 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:01.602491 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:01.737504 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:01.878783 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Allocated IP 172.27.3.125 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/97cc32c9-c8a9-4481-a623-39942c9723c4) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:31:02.027377 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:02.125429 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:02.131622 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:02.191448 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:31:02.194589 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:31:02.198256 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:31:02.238487 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'Port': ['ID=97cc32c9-c8a9-4481-a623-39942c9723c4,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:02.242559 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:02.288808 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:02.413742 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:02.540035 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:02.571253 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a69f3007-1207-422c-8adc-87fbe5934453 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:02.721465 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:02.814052 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:02.819052 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:02.931656 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'Port': ['ID=97cc32c9-c8a9-4481-a623-39942c9723c4,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:02.935537 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:02.942091 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:03.050846 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:03.052234 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-54dd79b8-3eef-4c0c-b477-07e705921cfc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.5704272
May 28 14:31:03.312332 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-1f670988-1ed4-4b3b-9d58-959746ad2c39 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-securitygroup--97907957&fields=id&tenant_id=3bbdb80ac64d4db395d276876322e7b0 HTTP/1.1" status: 200  len: 267 time: 0.0472441
May 28 14:31:03.472086 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-64aa1667-f893-4c32-bfd8-9aadcad0b68f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:03.472716 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-64aa1667-f893-4c32-bfd8-9aadcad0b68f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Synchronizing usage tracker for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:network {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:03.579260 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-64aa1667-f893-4c32-bfd8-9aadcad0b68f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Unset dirty status for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:network {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:03.581204 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-64aa1667-f893-4c32-bfd8-9aadcad0b68f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 817 time: 0.2619209
May 28 14:31:03.596643 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-3074d740-b27b-4efe-a358-cdbe02d43b37 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/quotas/3bbdb80ac64d4db395d276876322e7b0 HTTP/1.1" status: 200  len: 375 time: 0.0092025
May 28 14:31:03.681938 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-c0a1f5ce-67ab-49ec-8272-942f05c3bc1e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0801837
May 28 14:31:03.713372 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:03.907365 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-acc14b2a-6e93-4f90-a598-e476a60cd45a service neutron] 10.222.0.59 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2125943
May 28 14:31:04.040254 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-1eec1acf-8da7-4d83-b33e-ff37ffe45d86 service neutron] 10.222.0.59 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1265190
May 28 14:31:04.326538 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-02e61499-f8f6-48ff-948d-a45fbac12cc0 req-7001c973-6110-469a-ac90-a4fe4ef63940 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Synchronizing usage tracker for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:04.408063 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-02e61499-f8f6-48ff-948d-a45fbac12cc0 req-7001c973-6110-469a-ac90-a4fe4ef63940 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Unset dirty status for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:04.411601 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-02e61499-f8f6-48ff-948d-a45fbac12cc0 req-7001c973-6110-469a-ac90-a4fe4ef63940 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 210 time: 0.1277220
May 28 14:31:05.379347 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:05.601848 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0563d599-06d8-4305-974a-c4dfccffe2b0 req-e635ffe1-dcd0-4bb9-bfb4-758ab912687f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 210 time: 0.0759373
May 28 14:31:06.755500 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-75b087e0-8f60-4f37-97e9-68794967fb8e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:06.756938 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-75b087e0-8f60-4f37-97e9-68794967fb8e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 817 time: 0.1713965
May 28 14:31:06.779213 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4baad2ea-0cf1-41a2-9ace-4b05e02a30e6 req-9c7054ef-7362-4724-af93-5a0a33a98440 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 210 time: 0.0427966
May 28 14:31:06.820981 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-4aee4f1c-55a3-42a0-a9c3-8545dccfd2cc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3bbdb80ac64d4db395d276876322e7b0 HTTP/1.1" status: 200  len: 378 time: 0.0514524
May 28 14:31:06.833871 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'port': {'device_id': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'admin_state_up': True, 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'security_groups': ['ab91613c-a89d-4274-9712-4be0d63eeb3e']}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:06.975477 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:06.985476 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:07.059489 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Made reservation on behalf of 3bbdb80ac64d4db395d276876322e7b0 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:31:07.063072 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:07.233523 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Allocated IP 172.20.0.8 (936c4847-d3d4-4250-b543-dc72dd308858/a33b117b-9151-4e0d-a39e-2f027719309f/65e6ef94-43dd-499b-b9bb-2e42a8536b59) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:31:07.429840 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:07.447081 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Transition to ACTIVE for port object 65e6ef94-43dd-499b-b9bb-2e42a8536b59 will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:31:07.530803 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:07.537106 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:07.603904 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Network 936c4847-d3d4-4250-b543-dc72dd308858 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:31:07.607109 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:31:07.611147 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:31:07.643774 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:07.650527 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:07.684744 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:07.685382 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:07.794403 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.9648087
May 28 14:31:07.820102 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Request body: {'port': {'device_id': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:07.879323 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-57316f46-03a1-41d1-bdcb-4b23cbff7df6 None None] Provisioning for port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:31:07.885126 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-57316f46-03a1-41d1-bdcb-4b23cbff7df6 None None] Provisioning complete for port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:31:07.885553 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-57316f46-03a1-41d1-bdcb-4b23cbff7df6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:07.939888 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-57316f46-03a1-41d1-bdcb-4b23cbff7df6 None None] Port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:31:07.991704 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:08.093667 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953f3f36-2761-4b22-b55a-734353921fa8 req-19f5909f-a430-401a-b53e-ed0e2f6285b9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:08.098351 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-953f3f36-2761-4b22-b55a-734353921fa8 req-19f5909f-a430-401a-b53e-ed0e2f6285b9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Synchronizing usage tracker for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:08.244478 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-953f3f36-2761-4b22-b55a-734353921fa8 req-19f5909f-a430-401a-b53e-ed0e2f6285b9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Unset dirty status for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:08.245620 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-953f3f36-2761-4b22-b55a-734353921fa8 req-19f5909f-a430-401a-b53e-ed0e2f6285b9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 931 time: 0.3355842
May 28 14:31:08.330462 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-953f3f36-2761-4b22-b55a-734353921fa8 req-587288b4-8c0f-4e05-8082-1d9989f3b2a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0778270
May 28 14:31:08.412682 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 65e6ef94-43dd-499b-b9bb-2e42a8536b59 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:31:08.419958 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:08.434855 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Transition to ACTIVE for port object 65e6ef94-43dd-499b-b9bb-2e42a8536b59 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:31:08.513680 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:08.517597 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cc5c999b-240e-439f-8cd3-eeed81b06a43 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:08.756921 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:08.764533 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.246s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:08.843353 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Attempting to bind port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:31:08.844153 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Attempting to bind port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:31:08.844153 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Attempting to bind port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 on network 936c4847-d3d4-4250-b543-dc72dd308858 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:31:08.849386 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 on network 936c4847-d3d4-4250-b543-dc72dd308858 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:31:08.849713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Attempting to bind port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 on network 936c4847-d3d4-4250-b543-dc72dd308858 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:31:08.857896 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 30, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:31:08.858558 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Checking segment: {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:31:08.859134 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Bound using segment: {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:31:08.859602 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Bound port: 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '98da8543-e1f7-4222-b523-eef6806a46f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:31:08.859956 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:08.951628 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:31:08.954396 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:31:09.036896 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:09.040841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c0aef3a3-717b-4f8e-aed7-3e404cccc320 tempest-VolumesNegativeTest-1244350525 tempest-VolumesNegativeTest-1244350525-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:09.097990 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:09.098984 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:09.100672 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] 10.222.0.90 "PUT /v2.0/ports/65e6ef94-43dd-499b-b9bb-2e42a8536b59 HTTP/1.1" status: 200  len: 1093 time: 1.2967169
May 28 14:31:09.103575 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:09.129870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:09.133826 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:09.154116 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'status': 'completed', 'code': 200}
May 28 14:31:09.273323 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-e7205801-ebe5-46a7-8373-d44f1b85eb84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:09.273323 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-e7205801-ebe5-46a7-8373-d44f1b85eb84 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 1096 time: 0.0828030
May 28 14:31:09.423773 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-48073b51-730a-4cd6-9052-5e4893b7074b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:09.425856 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-48073b51-730a-4cd6-9052-5e4893b7074b service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=3bbdb80ac64d4db395d276876322e7b0&shared=False HTTP/1.1" status: 200  len: 918 time: 0.1499608
May 28 14:31:09.625486 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-6fdc5841-494e-40c0-a4ca-f82a857b9a97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:09.626940 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51a4e084-8a1b-4735-89ab-4d409f07ed0f req-6fdc5841-494e-40c0-a4ca-f82a857b9a97 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1946239
May 28 14:31:09.638785 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a30175e-a970-4919-a56b-c3bde1074c7a req-e74f36a8-e69e-4a97-8681-6b534a93886a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:09.640177 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3a30175e-a970-4919-a56b-c3bde1074c7a req-e74f36a8-e69e-4a97-8681-6b534a93886a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.1738465
May 28 14:31:09.726237 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3a30175e-a970-4919-a56b-c3bde1074c7a req-cf312224-0c15-46ba-8442-ee0eb934adca tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0800209
May 28 14:31:09.757248 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-549f1a20-ff77-446f-a565-5b4400eae889 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:09.758699 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-549f1a20-ff77-446f-a565-5b4400eae889 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 1096 time: 0.0802889
May 28 14:31:09.832073 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-db4fdda3-2538-4d85-8110-f5593bb2a2d7 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59 HTTP/1.1" status: 200  len: 217 time: 0.0648334
May 28 14:31:09.897255 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-ecc45703-dca3-4232-892c-f0a206e530d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:09.898918 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-ecc45703-dca3-4232-892c-f0a206e530d1 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.0601249
May 28 14:31:09.975963 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-436c48fd-f291-4243-817b-c8884f688b32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:09.981062 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-436c48fd-f291-4243-817b-c8884f688b32 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0710990
May 28 14:31:10.114555 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-87ad6db8-2d39-47a7-9e65-ead6429c7dad service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1299853
May 28 14:31:10.255829 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd23e2b8-d35d-445d-a164-dcd1354e209c req-1fd6beeb-cf72-4ee0-9d1b-2a908f08b0af service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1314523
May 28 14:31:10.928475 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac7763d-8109-476c-9082-7ec390cfd89c req-2226e8e8-5fd6-4ede-8ca4-3b62b76813ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:10.929942 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9ac7763d-8109-476c-9082-7ec390cfd89c req-2226e8e8-5fd6-4ede-8ca4-3b62b76813ae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0862269
May 28 14:31:10.978164 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-9ac7763d-8109-476c-9082-7ec390cfd89c req-cac5230f-9a82-4983-ab62-17fdb7da84cd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Synchronizing usage tracker for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:11.099517 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-9ac7763d-8109-476c-9082-7ec390cfd89c req-cac5230f-9a82-4983-ab62-17fdb7da84cd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Unset dirty status for tenant:3bbdb80ac64d4db395d276876322e7b0 on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:11.100926 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9ac7763d-8109-476c-9082-7ec390cfd89c req-cac5230f-9a82-4983-ab62-17fdb7da84cd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1653736
May 28 14:31:11.116386 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38818) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:11.240899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:11.256466 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:11.260291 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Usage tracker for resource:security_group_rule and tenant:de067a8f51c84a5081631279dc4b2201 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:11.263155 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:11.269632 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:11.350829 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:11.425601 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:11.434566 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ead0cc16-dfea-468d-b80d-ab69b5286948 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:11.476625 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=de067a8f51c84a5081631279dc4b2201&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3564680
May 28 14:31:11.476879 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 38828) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:11.478653 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f073248d-6580-4609-9d9d-7aecc675659a,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:11.481951 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:11.542968 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0c6a236c-d404-46eb-b034-4fbec6e26cff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:11.570301 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0c6a236c-d404-46eb-b034-4fbec6e26cff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:11.722474 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0c6a236c-d404-46eb-b034-4fbec6e26cff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:11.727658 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-69d12152-2f6f-44fd-9b15-4a87def98112 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:11.740158 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c6a236c-d404-46eb-b034-4fbec6e26cff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f073248d-6580-4609-9d9d-7aecc675659a,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:11.743070 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0c6a236c-d404-46eb-b034-4fbec6e26cff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:11.745045 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0c6a236c-d404-46eb-b034-4fbec6e26cff admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:11.746152 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-0c6a236c-d404-46eb-b034-4fbec6e26cff admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/f073248d-6580-4609-9d9d-7aecc675659a HTTP/1.1" status: 204  len: 168 time: 0.2678635
May 28 14:31:12.225187 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc81624-e377-4105-b144-c22ffe0f15ea req-59a8d935-fac7-473f-97f7-81aa097ba13a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:12.226681 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7bc81624-e377-4105-b144-c22ffe0f15ea req-59a8d935-fac7-473f-97f7-81aa097ba13a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 945 time: 0.0912132
May 28 14:31:12.288129 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7bc81624-e377-4105-b144-c22ffe0f15ea req-d9e4848a-f91c-4728-9b28-abddd543cd83 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0547683
May 28 14:31:12.324325 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 req-21ab1af3-cb62-41ed-a5e2-eb5880e8c54d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:12.325787 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 req-21ab1af3-cb62-41ed-a5e2-eb5880e8c54d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0901847
May 28 14:31:12.462252 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b0c20c6c-fb45-4784-a257-a458b02bbdf1 req-d1bb8bd9-20ff-410f-a519-2c07f63131d5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1307466
May 28 14:31:12.536979 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:31:13.108394 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 65e6ef94-43dd-499b-b9bb-2e42a8536b59 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:31:13.245534 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:13.261968 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'port_id': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'mac_address': 'fa:16:3e:ca:52:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 869, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:31:13.324454 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:13.343988 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 65e6ef94-43dd-499b-b9bb-2e42a8536b59 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:31:13.370545 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:13.462155 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:13.464084 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:13.465845 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f8f277-273e-413c-b679-1c7edea13880 req-a6d56998-84cd-426d-8214-07445899567a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:13.467306 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-39f8f277-273e-413c-b679-1c7edea13880 req-a6d56998-84cd-426d-8214-07445899567a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 945 time: 0.0791821
May 28 14:31:13.520868 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-39f8f277-273e-413c-b679-1c7edea13880 req-a59eb071-cf5c-453e-89c4-f3cf2606413b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0466368
May 28 14:31:13.543322 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:13.546455 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:13.689191 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714d5939-42b2-4c18-8889-8b4755f70307 req-a5ecd7b6-0e23-44f7-824b-db28caba2dae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:13.691216 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-714d5939-42b2-4c18-8889-8b4755f70307 req-a5ecd7b6-0e23-44f7-824b-db28caba2dae tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 944 time: 0.0890696
May 28 14:31:13.741430 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-714d5939-42b2-4c18-8889-8b4755f70307 req-e0a2ebed-726d-43ce-93dd-29cd2c784f25 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0445383
May 28 14:31:14.149945 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['65e6ef94-43dd-499b-b9bb-2e42a8536b59'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:31:14.330639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-22ffe0e9-4ddc-42b9-8c9c-aae6bf971017 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:14.332300 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-22ffe0e9-4ddc-42b9-8c9c-aae6bf971017 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 945 time: 0.1010845
May 28 14:31:14.479370 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Deleting port 4b79b510-d52c-4720-bf56-28c541fff0b4 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:31:14.479750 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:14.620781 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] For port 4b79b510-d52c-4720-bf56-28c541fff0b4, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=4b79b510-d52c-4720-bf56-28c541fff0b4,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:14.621129 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:14.727972 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6469b95-babf-4872-b95e-0929c45d1f60 req-ab18cbed-c421-4b8e-a33b-eba71abffe2d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:14.730071 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f6469b95-babf-4872-b95e-0929c45d1f60 req-ab18cbed-c421-4b8e-a33b-eba71abffe2d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 945 time: 0.0908413
May 28 14:31:14.778596 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f6469b95-babf-4872-b95e-0929c45d1f60 req-8098e5ed-4e08-490a-af99-d049c439b5b9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405579
May 28 14:31:14.983404 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:14.983869 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:14.984167 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.l3_db [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Floating IP 854345b8-80df-4572-a7ab-7dc03f1483b1 disassociated. External IP: 172.27.3.250, port: 4b79b510-d52c-4720-bf56-28c541fff0b4.
May 28 14:31:14.984501 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling delete_port for 4b79b510-d52c-4720-bf56-28c541fff0b4 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:31:15.026025 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 req-fbb48dca-fd71-4f15-8a77-7096f3410b3f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:15.027496 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 req-fbb48dca-fd71-4f15-8a77-7096f3410b3f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 944 time: 0.1388726
May 28 14:31:15.084807 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-24608cda-c90a-4bc2-a0a3-9b4389ffd091 req-875fa98e-fa38-4bc1-927b-69b007c9fb38 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0505950
May 28 14:31:15.112376 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 65e6ef94-43dd-499b-b9bb-2e42a8536b59 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:31:15.250725 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:15.256752 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:15.300421 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event deleted for resources: {'Port': ['ID=4b79b510-d52c-4720-bf56-28c541fff0b4,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:15.304006 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:15.339422 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:31:15.345275 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:31:15.346145 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:15.471862 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:15.495529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Router 0cb62432-a4fe-4ba8-9099-f616594e4211 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:31:15.499281 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:15.510087 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:15.551945 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'code': 200}
May 28 14:31:15.586088 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:15.589065 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-69f8ae51-0c8a-44ad-9239-b4dd454f87fb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:15.664909 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:15.668780 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:15.684525 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:31:15.695175 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] Sync routers for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:31:15.706119 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:15.706794 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27d26a0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:15.864345 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] No DVR routers for this DVR port 4b79b510-d52c-4720-bf56-28c541fff0b4 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:31:15.866897 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:15.869901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'name': 'network-vif-deleted', 'tag': '4b79b510-d52c-4720-bf56-28c541fff0b4'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:15.955672 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:15.989946 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2be0a35c-b0fe-4a26-b785-3e16aa182171', 'name': 'network-vif-deleted', 'tag': '4b79b510-d52c-4720-bf56-28c541fff0b4', 'status': 'completed', 'code': 200}
May 28 14:31:16.004449 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-1b909a26-2fa2-4d16-aa16-2d745e921626 req-fa5ec056-c929-4433-be1e-0474a4d701b8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:16.036810 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-1b909a26-2fa2-4d16-aa16-2d745e921626 req-fa5ec056-c929-4433-be1e-0474a4d701b8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:16.037980 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1b909a26-2fa2-4d16-aa16-2d745e921626 req-fa5ec056-c929-4433-be1e-0474a4d701b8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 210 time: 0.1197207
May 28 14:31:16.046939 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ed3144b9-566a-4468-a9e2-baa0b8b3d923 req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "DELETE /v2.0/ports/4b79b510-d52c-4720-bf56-28c541fff0b4 HTTP/1.1" status: 204  len: 173 time: 1.7064917
May 28 14:31:16.062410 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81880853-d2df-47a2-abb8-3c738a6c14de req-087c5568-3cbb-493a-a9d8-a83ce92f144a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:16.063763 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-81880853-d2df-47a2-abb8-3c738a6c14de req-087c5568-3cbb-493a-a9d8-a83ce92f144a service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 1098 time: 0.1054199
May 28 14:31:16.112690 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-81880853-d2df-47a2-abb8-3c738a6c14de req-e2b79306-03ea-4697-92df-b03f9d5eacd6 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0409629
May 28 14:31:16.300406 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a007640a-5fb9-4fa6-833e-0a17814de872 req-40a2be29-f29a-4762-ace4-651f82cd2327 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:16.302921 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a007640a-5fb9-4fa6-833e-0a17814de872 req-40a2be29-f29a-4762-ace4-651f82cd2327 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0921299
May 28 14:31:16.350380 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a007640a-5fb9-4fa6-833e-0a17814de872 req-2b5920f0-7250-4bb5-87e4-de3cf382b688 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0411866
May 28 14:31:16.358036 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27d26a0>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:16.359505 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] Checking router: 0cb62432-a4fe-4ba8-9099-f616594e4211 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:31:16.372341 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:16.373202 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27d26a0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:16.556274 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:16.886906 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27d26a0>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:16.890836 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7122d69-76ea-4bb2-82d2-f6c5560f8618 None None] The sync data for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi is: [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:31:17.108250 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4494c147-25eb-4dc5-a88b-bd45b4628cd7 None None] New status for floating IP 854345b8-80df-4572-a7ab-7dc03f1483b1: DOWN {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:31:17.116515 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 4b79b510-d52c-4720-bf56-28c541fff0b4 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:31:17.154494 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 4b79b510-d52c-4720-bf56-28c541fff0b4 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:31:17.154989 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 4b79b510-d52c-4720-bf56-28c541fff0b4 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:31:17.234834 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ddecf392-0eab-411a-b83c-94ab01c40e9a req-bc64d1b7-f625-4f20-b05f-4525648f2652 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=2be0a35c-b0fe-4a26-b785-3e16aa182171 HTTP/1.1" status: 200  len: 210 time: 0.0465589
May 28 14:31:17.554119 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b76a81f6-8eda-4287-a61f-404f96688a65 req-891266f4-f902-4c0f-9769-32cc58554644 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:17.555682 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b76a81f6-8eda-4287-a61f-404f96688a65 req-891266f4-f902-4c0f-9769-32cc58554644 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0893137
May 28 14:31:17.601687 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b76a81f6-8eda-4287-a61f-404f96688a65 req-fa266c02-dc4e-464a-922b-68685096c573 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0403018
May 28 14:31:18.597124 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-a510d3d0-f3f8-42d2-a0c5-d61ff5c1fad2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2127224596&fields=id&tenant_id=c6d2d25991f04f00a48394ddbeec688e HTTP/1.1" status: 200  len: 267 time: 0.0449862
May 28 14:31:18.761191 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-4d633dd8-3cb2-4e7e-bb12-637431d1d835 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:18.761885 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-4d633dd8-3cb2-4e7e-bb12-637431d1d835 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:network {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:18.808341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1847ebd-c136-4538-ab47-7202ac69ce02 req-3dbb07c1-3c8b-4b85-a0a4-138fc4b05162 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:18.809714 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d1847ebd-c136-4538-ab47-7202ac69ce02 req-3dbb07c1-3c8b-4b85-a0a4-138fc4b05162 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0870695
May 28 14:31:18.855387 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d1847ebd-c136-4538-ab47-7202ac69ce02 req-3c941f0c-b81b-4629-b9b2-fae91966127d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0389125
May 28 14:31:18.882101 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-4d633dd8-3cb2-4e7e-bb12-637431d1d835 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:network {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:18.883352 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-4d633dd8-3cb2-4e7e-bb12-637431d1d835 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 812 time: 0.2801628
May 28 14:31:18.899713 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-9218040a-b17f-405c-b25c-9e0653dcc88c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/quotas/c6d2d25991f04f00a48394ddbeec688e HTTP/1.1" status: 200  len: 375 time: 0.0100009
May 28 14:31:18.994924 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-95c09d1a-e3d2-4ddb-b262-2b3e1ecd550c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0898132
May 28 14:31:19.014738 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-ad035348-9622-4bfd-b527-ea32df999db5 service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92694) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:31:19.015758 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-ad035348-9622-4bfd-b527-ea32df999db5 service neutron] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0089552
May 28 14:31:19.050845 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb8ba09-c3c8-43e4-8fab-d7cc012ad0aa req-de5f588e-d1c6-4657-ab35-d852a4a37a86 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:19.056069 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bcb8ba09-c3c8-43e4-8fab-d7cc012ad0aa req-de5f588e-d1c6-4657-ab35-d852a4a37a86 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0918565
May 28 14:31:19.060692 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 38980) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:19.066295 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-cb7cdd50-273e-4edc-a676-a7b1ab19410e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Request body: {'floatingip': {'port_id': '65e6ef94-43dd-499b-b9bb-2e42a8536b59'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:19.147416 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cb7cdd50-273e-4edc-a676-a7b1ab19410e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:19.159664 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-a5eed6f3-67b3-400a-ab3b-e4bcd542250c service neutron] 10.222.0.59 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1351054
May 28 14:31:19.301509 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-7867f963-f9a2-4543-add8-6e1f2be110b9 service neutron] 10.222.0.59 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1309652
May 28 14:31:19.933051 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cb7cdd50-273e-4edc-a676-a7b1ab19410e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:20.019380 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cb7cdd50-273e-4edc-a676-a7b1ab19410e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:20.237591 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0b3637b2-a25e-4128-896a-66c1238ba051 req-d5fadc70-9bb5-45f7-bb0f-4d21b2aa5345 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 210 time: 0.0704539
May 28 14:31:20.335524 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.l3_db [None req-cb7cdd50-273e-4edc-a676-a7b1ab19410e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Floating IP ad224509-05f5-49ff-bcce-8640d345cf54 associated. External IP: 172.27.3.125, port: 65e6ef94-43dd-499b-b9bb-2e42a8536b59.
May 28 14:31:20.692078 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb7cdd50-273e-4edc-a676-a7b1ab19410e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Router 93611a0c-a5d3-438a-bf94-7453623f231d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:31:20.873742 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb7cdd50-273e-4edc-a676-a7b1ab19410e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:31:20.878641 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-cb7cdd50-273e-4edc-a676-a7b1ab19410e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:20.885739 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] Sync routers for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:31:20.897221 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:20.898096 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba17bbdf0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:20.971649 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-cb7cdd50-273e-4edc-a676-a7b1ab19410e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "PUT /v2.0/floatingips/ad224509-05f5-49ff-bcce-8640d345cf54 HTTP/1.1" status: 200  len: 991 time: 1.9098871
May 28 14:31:20.975409 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:21.031934 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'status': 'completed', 'code': 200}
May 28 14:31:21.096389 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:21.144320 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-d66a9b55-2922-49fb-8d69-0543a5a06146 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:21.146037 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-d66a9b55-2922-49fb-8d69-0543a5a06146 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 1098 time: 0.0850377
May 28 14:31:21.297263 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-75bb5649-9a6c-4987-b091-68ebfed1acfc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:21.299335 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-75bb5649-9a6c-4987-b091-68ebfed1acfc service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.1451137
May 28 14:31:21.434728 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8df8ff66-a15c-43ab-a3c2-235ad07fb33c req-ea5f03b8-a6ed-402b-bb62-59c9d5943367 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 210 time: 0.0692599
May 28 14:31:21.453321 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-b284aef1-ea91-47b8-8d90-b27c5813908e service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59 HTTP/1.1" status: 200  len: 999 time: 0.1477549
May 28 14:31:21.499046 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba17bbdf0>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'ad224509-05f5-49ff-bcce-8640d345cf54', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'floating_ip_address': '172.27.3.125', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'port_id': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'mac_address': 'fa:16:3e:ca:52:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:02Z', 'updated_at': '2021-05-28T14:31:19Z', 'revision_number': 1, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:21.503026 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] Checking router: 93611a0c-a5d3-438a-bf94-7453623f231d for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:31:21.511764 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:21.512390 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba17bbdf0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:21.533042 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-21330a09-192e-4033-a87b-af5dfee593fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:21.538033 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-21330a09-192e-4033-a87b-af5dfee593fb service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.0723417
May 28 14:31:21.554674 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39032) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:21.617947 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-f1e1adbf-ec65-44eb-8daf-89e95be812f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:21.619425 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-f1e1adbf-ec65-44eb-8daf-89e95be812f6 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0768354
May 28 14:31:21.695922 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:21.715278 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:21.719609 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Usage tracker for resource:security_group_rule and tenant:b995acf4bccd4e0e954a62aae38467bd is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:21.723106 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:21.730242 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:21.755389 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:21.818414 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:21.873818 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-9bab9e14-0167-4475-a057-c6fcb758cffe service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2466595
May 28 14:31:21.879145 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:21.887964 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-71075329-9931-4246-affc-9097a427d30a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:22.027644 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=b995acf4bccd4e0e954a62aae38467bd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4711015
May 28 14:31:22.028238 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39040) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:22.030734 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=320855c6-ec17-49a1-a14b-ec39632d2d9b,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:22.054918 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:22.058777 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9e813390-2566-4dc1-ade6-167faa0e6b24 req-c121c1d1-bf0e-4c38-ab61-cde56ba543f2 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1708157
May 28 14:31:22.112457 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7b97f9d7-2b8e-4ddf-8e7f-cfb3c1b04063 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:22.140279 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7b97f9d7-2b8e-4ddf-8e7f-cfb3c1b04063 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:22.153990 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba17bbdf0>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'ad224509-05f5-49ff-bcce-8640d345cf54', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'floating_ip_address': '172.27.3.125', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'port_id': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'mac_address': 'fa:16:3e:ca:52:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:02Z', 'updated_at': '2021-05-28T14:31:19Z', 'revision_number': 1, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:22.158061 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88b833fa-bc1a-4c66-93ce-27c3cc04c96e None None] The sync data for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi is: [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'ad224509-05f5-49ff-bcce-8640d345cf54', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'floating_ip_address': '172.27.3.125', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'port_id': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'mac_address': 'fa:16:3e:ca:52:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:02Z', 'updated_at': '2021-05-28T14:31:19Z', 'revision_number': 1, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:31:22.259132 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7b97f9d7-2b8e-4ddf-8e7f-cfb3c1b04063 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:22.264385 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-abae7551-a4a2-4069-9b5b-d0f183f34dc4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:22.277282 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b97f9d7-2b8e-4ddf-8e7f-cfb3c1b04063 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=320855c6-ec17-49a1-a14b-ec39632d2d9b,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:22.280332 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7b97f9d7-2b8e-4ddf-8e7f-cfb3c1b04063 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:22.282364 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7b97f9d7-2b8e-4ddf-8e7f-cfb3c1b04063 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:22.283987 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-7b97f9d7-2b8e-4ddf-8e7f-cfb3c1b04063 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/320855c6-ec17-49a1-a14b-ec39632d2d9b HTTP/1.1" status: 204  len: 168 time: 0.2546976
May 28 14:31:22.404007 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-8c1c4dcf-f9a0-4d98-836f-80c067d5c4ec tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:22.406243 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-8c1c4dcf-f9a0-4d98-836f-80c067d5c4ec tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 812 time: 0.1785188
May 28 14:31:22.424627 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db0f71c9-608b-41e7-bdf9-79c25f81dc1d None None] New status for floating IP ad224509-05f5-49ff-bcce-8640d345cf54: ACTIVE {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:31:22.502217 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-874697af-14af-42cb-abfb-fc264ce582f8 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c6d2d25991f04f00a48394ddbeec688e HTTP/1.1" status: 200  len: 380 time: 0.0853248
May 28 14:31:22.510953 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'port': {'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'admin_state_up': True, 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'security_groups': ['fe9fa133-b1e0-4e56-971e-af9cdb27b031']}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:22.656355 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f87f3c4e-9538-482e-ad86-47ba75de7e6a req-0b013b66-080f-453f-86c2-d58b0bcaf472 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 210 time: 0.0771468
May 28 14:31:22.721145 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:22.725870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:port and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:22.730014 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:22.734699 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:22.838960 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Made reservation on behalf of c6d2d25991f04f00a48394ddbeec688e for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:31:22.842686 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.006600 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Allocated IP 172.20.0.9 (89b0ce92-0695-466c-b1ce-9a354ecba633/a63662e1-f44d-44cd-98c9-2b87dba66278/a1d19f37-64ae-4f18-a8f2-79559df44a3b) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:31:23.128116 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39054) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:23.146989 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.162495 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:23.166517 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Usage tracker for resource:security_group_rule and tenant:3b56d17d7c844887bc72cb49c149077b is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:23.169785 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:23.176082 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:23.203802 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.219491 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Transition to ACTIVE for port object a1d19f37-64ae-4f18-a8f2-79559df44a3b will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:31:23.257923 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.365249 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.370785 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:23.422016 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.434694 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-43cfa272-d1a1-4af0-ac4f-31fb9452d781 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:23.440870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:31:23.444136 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:31:23.447818 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:31:23.478040 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=3b56d17d7c844887bc72cb49c149077b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3487830
May 28 14:31:23.479196 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=364e0e11-0b34-4098-a631-dbdbc992af40,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:23.480956 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 39060) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:23.482101 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'Port': ['ID=a1d19f37-64ae-4f18-a8f2-79559df44a3b,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:23.483073 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:23.485962 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:23.564875 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:23.565512 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.594571 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b7833438-47bb-4758-b9a9-2340b79eb78f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.633414 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b7833438-47bb-4758-b9a9-2340b79eb78f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.728874 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2217329
May 28 14:31:23.740122 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Request body: {'port': {'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:23.815129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-89e158b3-a212-4087-9e90-dde1cb1b0b15 None None] Provisioning for port a1d19f37-64ae-4f18-a8f2-79559df44a3b completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:31:23.822529 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-89e158b3-a212-4087-9e90-dde1cb1b0b15 None None] Provisioning complete for port a1d19f37-64ae-4f18-a8f2-79559df44a3b triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:31:23.822908 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-89e158b3-a212-4087-9e90-dde1cb1b0b15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.828302 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b7833438-47bb-4758-b9a9-2340b79eb78f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.837519 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-508d0ce6-d2ad-44dd-b3f5-017a4098181c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:23.865733 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7833438-47bb-4758-b9a9-2340b79eb78f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=364e0e11-0b34-4098-a631-dbdbc992af40,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:23.888986 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-89e158b3-a212-4087-9e90-dde1cb1b0b15 None None] Port a1d19f37-64ae-4f18-a8f2-79559df44a3b cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:31:23.900240 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b7833438-47bb-4758-b9a9-2340b79eb78f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:23.915626 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b7833438-47bb-4758-b9a9-2340b79eb78f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.916737 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-b7833438-47bb-4758-b9a9-2340b79eb78f admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/364e0e11-0b34-4098-a631-dbdbc992af40 HTTP/1.1" status: 204  len: 168 time: 0.4324243
May 28 14:31:23.935614 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:23.992445 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 req-f37bcaae-88b8-401a-8b36-821a8c3b2cd2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:23.993127 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 req-f37bcaae-88b8-401a-8b36-821a8c3b2cd2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:24.124326 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 req-f37bcaae-88b8-401a-8b36-821a8c3b2cd2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:24.125467 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 req-f37bcaae-88b8-401a-8b36-821a8c3b2cd2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 931 time: 0.3603036
May 28 14:31:24.343447 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d4b012d1-17c2-4e7b-a414-ea5147b9e0b7 req-f42b031e-26c3-43fc-8a20-699b71aed6da tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1727884
May 28 14:31:24.440718 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a1d19f37-64ae-4f18-a8f2-79559df44a3b {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:31:24.448051 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:24.462632 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Transition to ACTIVE for port object a1d19f37-64ae-4f18-a8f2-79559df44a3b will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:31:24.573576 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:24.578335 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-335e2553-3a74-4183-a813-c36e8cfa5c90 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:24.731515 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Pushing event updated for resources: {'Port': ['ID=a1d19f37-64ae-4f18-a8f2-79559df44a3b,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:24.739508 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:24.778610 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39074) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:24.796629 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:24.817568 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Attempting to bind port a1d19f37-64ae-4f18-a8f2-79559df44a3b on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:31:24.817902 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Attempting to bind port a1d19f37-64ae-4f18-a8f2-79559df44a3b by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:31:24.818230 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Attempting to bind port a1d19f37-64ae-4f18-a8f2-79559df44a3b on network 89b0ce92-0695-466c-b1ce-9a354ecba633 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:31:24.823108 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Port a1d19f37-64ae-4f18-a8f2-79559df44a3b on network 89b0ce92-0695-466c-b1ce-9a354ecba633 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:31:24.823577 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Attempting to bind port a1d19f37-64ae-4f18-a8f2-79559df44a3b on network 89b0ce92-0695-466c-b1ce-9a354ecba633 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:31:24.829873 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:24.830050 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 30, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:31:24.830390 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Checking segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:31:24.830795 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Bound using segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:31:24.831224 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Bound port: a1d19f37-64ae-4f18-a8f2-79559df44a3b, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:31:24.831593 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:24.833687 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] Usage tracker for resource:security_group_rule and tenant:ee78a83103ad403e9eccc9652f5e67c1 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:24.836474 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:24.842246 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:24.922745 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:24.925694 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] For port a1d19f37-64ae-4f18-a8f2-79559df44a3b, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:31:24.928654 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] For port a1d19f37-64ae-4f18-a8f2-79559df44a3b, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:31:25.013177 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:25.020544 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-00aae515-f9a2-4210-9b38-b0c86b6d9ea1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:25.039213 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:25.044069 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:25.064603 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ee78a83103ad403e9eccc9652f5e67c1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2822511
May 28 14:31:25.064603 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b803468c-149a-4969-9535-224016f2ddb1,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:25.066118 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39078) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:25.068694 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-bc90074d-c8ed-41ec-8b56-4222f429011d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:25.102312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:25.102911 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:25.104270 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] 10.222.0.90 "PUT /v2.0/ports/a1d19f37-64ae-4f18-a8f2-79559df44a3b HTTP/1.1" status: 200  len: 1093 time: 1.3682981
May 28 14:31:25.104761 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:25.134674 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Pushing event updated for resources: {'Port': ['ID=a1d19f37-64ae-4f18-a8f2-79559df44a3b,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:25.138984 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:25.141017 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7539c740-2fbd-4fc5-9cfe-fb37b52a3f28 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:25.166793 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'status': 'completed', 'code': 200}
May 28 14:31:25.169025 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7539c740-2fbd-4fc5-9cfe-fb37b52a3f28 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:25.267983 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03748d16-ffc8-46ee-8687-69822648507c req-2bedab9e-46da-4b0f-8313-28d24a97cff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:25.269554 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-03748d16-ffc8-46ee-8687-69822648507c req-2bedab9e-46da-4b0f-8313-28d24a97cff2 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 1096 time: 0.0811350
May 28 14:31:25.416463 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7539c740-2fbd-4fc5-9cfe-fb37b52a3f28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:25.420304 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03748d16-ffc8-46ee-8687-69822648507c req-e0d66011-daf6-442c-9a6f-b24a42261973 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:25.421897 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-03748d16-ffc8-46ee-8687-69822648507c req-e0d66011-daf6-442c-9a6f-b24a42261973 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=c6d2d25991f04f00a48394ddbeec688e&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1413417
May 28 14:31:25.424519 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-1467dd12-54b6-4711-812a-2c62152b1592 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:25.437493 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7539c740-2fbd-4fc5-9cfe-fb37b52a3f28 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b803468c-149a-4969-9535-224016f2ddb1,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:25.442428 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7539c740-2fbd-4fc5-9cfe-fb37b52a3f28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:25.451318 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7539c740-2fbd-4fc5-9cfe-fb37b52a3f28 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:25.451318 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-7539c740-2fbd-4fc5-9cfe-fb37b52a3f28 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b803468c-149a-4969-9535-224016f2ddb1 HTTP/1.1" status: 204  len: 168 time: 0.3791666
May 28 14:31:25.543980 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdeb2595-e167-47da-b7cb-0d2802b38032 req-fffc8655-df06-42bb-a44e-dcd6555dcd8b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:25.545667 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bdeb2595-e167-47da-b7cb-0d2802b38032 req-fffc8655-df06-42bb-a44e-dcd6555dcd8b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 943 time: 0.0850084
May 28 14:31:25.574336 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03748d16-ffc8-46ee-8687-69822648507c req-daa37adb-81ed-4676-a419-062254ce07d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:25.575798 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-03748d16-ffc8-46ee-8687-69822648507c req-daa37adb-81ed-4676-a419-062254ce07d9 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1470189
May 28 14:31:25.600215 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bdeb2595-e167-47da-b7cb-0d2802b38032 req-e78bcfe4-c781-4432-8c86-0fe02c5b607f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0462894
May 28 14:31:25.684922 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-81aa2d13-8d89-431b-9084-7138f526f16c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:25.686465 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-81aa2d13-8d89-431b-9084-7138f526f16c service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 1096 time: 0.0707479
May 28 14:31:25.758432 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-23b32742-9e8c-40c5-9a68-be7eddbfea06 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b HTTP/1.1" status: 200  len: 217 time: 0.0646100
May 28 14:31:25.822033 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-099a3d58-66e4-4771-960a-002f1b330333 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:25.826731 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-099a3d58-66e4-4771-960a-002f1b330333 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.0584092
May 28 14:31:25.905717 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-634f3f9b-3fb2-4a45-88ab-1ab24c2ee78c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:25.907184 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-634f3f9b-3fb2-4a45-88ab-1ab24c2ee78c service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0754120
May 28 14:31:26.045769 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-87dcf77d-0912-4e83-93db-d9d383ebad72 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1300790
May 28 14:31:26.182223 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8667a337-b73f-40d2-90b9-9b160d8a75d3 req-663b6141-07ef-4373-a387-2fb5add7a0c8 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1276352
May 28 14:31:26.614994 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-0ed177bb-1a55-4252-b1ab-23ebd6c82fe5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Synchronizing usage tracker for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:26.724502 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-0ed177bb-1a55-4252-b1ab-23ebd6c82fe5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Unset dirty status for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:26.725874 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-0ed177bb-1a55-4252-b1ab-23ebd6c82fe5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1469735783&fields=id&tenant_id=26daec94fed843c8b74a9ff7d18ecdb5 HTTP/1.1" status: 200  len: 267 time: 0.1521895
May 28 14:31:26.788853 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55db302-40ff-4aa9-8b7a-410f8c60a844 req-d246f24f-d150-4651-ac88-24bc8c3b3046 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:26.790552 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c55db302-40ff-4aa9-8b7a-410f8c60a844 req-d246f24f-d150-4651-ac88-24bc8c3b3046 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 943 time: 0.0799000
May 28 14:31:26.848348 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c55db302-40ff-4aa9-8b7a-410f8c60a844 req-7a1cb96d-00a9-4ee3-a6dc-b8f57cf9f52e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0515532
May 28 14:31:26.897329 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8d09a1af-1b7b-407e-94b4-4a8ca11d204d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:26.898256 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8d09a1af-1b7b-407e-94b4-4a8ca11d204d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Synchronizing usage tracker for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:network {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:26.999146 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8d09a1af-1b7b-407e-94b4-4a8ca11d204d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Unset dirty status for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:network {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:27.000363 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8d09a1af-1b7b-407e-94b4-4a8ca11d204d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/networks?id=cf0db8bd-5a73-44bf-9367-58867c9e819f HTTP/1.1" status: 200  len: 806 time: 0.2672031
May 28 14:31:27.028147 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-b82016bf-f579-43a3-9135-2b8ead546aae tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/quotas/26daec94fed843c8b74a9ff7d18ecdb5 HTTP/1.1" status: 200  len: 375 time: 0.0094254
May 28 14:31:27.112837 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-9669c1af-eafb-45f9-83c1-3a8242db65b3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Synchronizing usage tracker for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:27.227135 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-9669c1af-eafb-45f9-83c1-3a8242db65b3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Unset dirty status for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:27.228560 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-9669c1af-eafb-45f9-83c1-3a8242db65b3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1997142
May 28 14:31:27.366734 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-f86d32a1-a314-49b3-b7a5-46932f5ddcfb service neutron] 10.222.0.59 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1265864
May 28 14:31:27.502228 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-64d92da2-28f7-4856-b428-80ee9ced1cd8 service neutron] 10.222.0.59 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1289601
May 28 14:31:27.624252 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 39142) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:27.742968 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:27.757652 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:27.761394 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Usage tracker for resource:security_group_rule and tenant:085773dfafd1488facd18b2792715a4b is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:27.764206 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:27.770259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:27.908482 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:27.996805 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:28.040835 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 req-d398b17d-72bb-4a91-9e9c-bc5edb3061a0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:28.042260 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 req-d398b17d-72bb-4a91-9e9c-bc5edb3061a0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 943 time: 0.0855067
May 28 14:31:28.077177 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:28.089017 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e904370e-0532-48ba-a9ab-65a862f72a3c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:28.110930 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0ebccab1-a0b8-47f6-abe1-bfb2d96a9b85 req-67b0dadf-0ba4-418a-bc73-2d1e2b8d8dc3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0630715
May 28 14:31:28.143517 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cafd997c-703b-406e-8d0d-3340957b822f,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:28.151280 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=085773dfafd1488facd18b2792715a4b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5259421
May 28 14:31:28.154592 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39160) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:28.156761 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.157346 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.157772 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.158303 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.158658 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.159020 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.159361 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.159735 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.160083 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.172402 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.172402 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.172402 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:28.172402 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1a87e44e-1d9a-42d7-a202-6e88872d02b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:28.222544 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-66803c76-e218-4351-8a0b-093a8daaabac req-036183d4-3bb6-4ea4-864f-73afba229dfc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 210 time: 0.0525324
May 28 14:31:28.273852 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9140c4ab-d1c0-4fb7-8701-b0e6d64354ed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:28.302230 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9140c4ab-d1c0-4fb7-8701-b0e6d64354ed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:28.487376 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9140c4ab-d1c0-4fb7-8701-b0e6d64354ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:28.492300 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8b01f446-dca9-4edb-9bd6-a2b62146758d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:28.504335 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9140c4ab-d1c0-4fb7-8701-b0e6d64354ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cafd997c-703b-406e-8d0d-3340957b822f,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:28.507215 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-9140c4ab-d1c0-4fb7-8701-b0e6d64354ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:28.509135 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-9140c4ab-d1c0-4fb7-8701-b0e6d64354ed admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:28.511595 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-9140c4ab-d1c0-4fb7-8701-b0e6d64354ed admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/cafd997c-703b-406e-8d0d-3340957b822f HTTP/1.1" status: 204  len: 168 time: 0.3542054
May 28 14:31:29.304967 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecb3638-b861-4e60-9af0-9858d6430092 req-17c27e18-9fb6-4358-8be1-5482c885035c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:29.306425 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5ecb3638-b861-4e60-9af0-9858d6430092 req-17c27e18-9fb6-4358-8be1-5482c885035c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 943 time: 0.0854366
May 28 14:31:29.323198 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-69c7eee0-be19-42df-93f2-3ad1434c6745 req-c400be43-7520-49de-9d92-840db3a7fc67 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 210 time: 0.0444312
May 28 14:31:29.354433 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5ecb3638-b861-4e60-9af0-9858d6430092 req-04adda92-3bc3-44cd-bb92-631161329968 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0422256
May 28 14:31:30.084665 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-62e2fa58-c2f4-409d-ab31-1e5800968e69 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:30.473516 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-01c5983a-a701-4791-afa0-f23f7e230961 req-42832966-d295-4f25-9eda-526856a39b68 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 210 time: 0.0430470
May 28 14:31:30.563609 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58199a62-29f4-437e-991c-758f61c5b287 req-430a3415-bf58-411d-94e4-d41d26b7f0fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:30.565727 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-58199a62-29f4-437e-991c-758f61c5b287 req-430a3415-bf58-411d-94e4-d41d26b7f0fa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 943 time: 0.0874195
May 28 14:31:30.613438 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-58199a62-29f4-437e-991c-758f61c5b287 req-fa3b54e2-3c86-41f2-a674-500a74fdcd97 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0420308
May 28 14:31:31.277769 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-635ef5e8-99f3-48d1-a0e9-be9b58460059 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:31.279120 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-635ef5e8-99f3-48d1-a0e9-be9b58460059 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.90 "GET /v2.0/networks?id=cf0db8bd-5a73-44bf-9367-58867c9e819f HTTP/1.1" status: 200  len: 806 time: 0.1457868
May 28 14:31:31.330792 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-cd5d2f9f-7e71-4fb2-8441-104d3e518621 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Synchronizing usage tracker for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:security_group {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:31.342251 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-cd5d2f9f-7e71-4fb2-8441-104d3e518621 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Unset dirty status for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:security_group {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:31.343340 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-cd5d2f9f-7e71-4fb2-8441-104d3e518621 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=26daec94fed843c8b74a9ff7d18ecdb5 HTTP/1.1" status: 200  len: 380 time: 0.0523281
May 28 14:31:31.353730 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Request body: {'port': {'device_id': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'admin_state_up': True, 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'security_groups': ['9ab39ed0-1a7b-48aa-865b-cdecc297916b']}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:31.490887 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:31.511485 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:31.616053 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Made reservation on behalf of 26daec94fed843c8b74a9ff7d18ecdb5 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:31:31.626726 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:31.851916 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Allocated IP 172.20.0.12 (cf0db8bd-5a73-44bf-9367-58867c9e819f/4a437a5e-a3c1-4c29-a8be-fade6c84b5f4/e27f7a0e-7e77-4d61-a393-fe4fde4153d5) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:31:31.860071 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4502371d-3058-46fe-b974-85b082ce64b6 req-a7cf7894-040c-4ca4-9dd1-9b77abd9504f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 210 time: 0.2750013
May 28 14:31:32.116335 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 req-0464749f-7c06-410e-a23e-342be3bacc1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:32.117718 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 req-0464749f-7c06-410e-a23e-342be3bacc1a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 943 time: 0.2780213
May 28 14:31:32.122458 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:32.157427 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Transition to ACTIVE for port object e27f7a0e-7e77-4d61-a393-fe4fde4153d5 will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:31:32.179899 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bb5b31dd-dfbb-4800-98da-0fe2bfcacf21 req-1ee52a29-daae-4d4a-a981-c5654b4d2e88 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0539696
May 28 14:31:32.256409 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:32.261914 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b2c21b18-e80c-43bd-9d91-05339bbeee55 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:32.328904 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Network cf0db8bd-5a73-44bf-9367-58867c9e819f is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:31:32.332603 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:31:32.336184 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:31:32.375743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'Port': ['ID=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:32.377473 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:32.410705 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:32.410705 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:32.619404 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.2691159
May 28 14:31:32.637954 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-ce3b82b6-5d04-4a18-9653-b8ca9b18f91b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92695) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:31:32.637954 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-ce3b82b6-5d04-4a18-9653-b8ca9b18f91b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.90 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0050118
May 28 14:31:32.677013 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-e4eaafde-1913-4c39-8b9c-c913d343ba6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:32.679978 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-f10a598d-95de-455b-a910-61e2f761900c None None] Provisioning for port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:31:32.684732 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:32.695443 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-f10a598d-95de-455b-a910-61e2f761900c None None] Provisioning complete for port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:31:32.695443 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f10a598d-95de-455b-a910-61e2f761900c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:32.702273 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Request body: {'port': {'device_id': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:32.744258 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-f10a598d-95de-455b-a910-61e2f761900c None None] Port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:31:32.816345 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:33.271123 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 req-5e22e240-385c-4c90-98df-d3522600c217 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:33.271899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 req-5e22e240-385c-4c90-98df-d3522600c217 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Synchronizing usage tracker for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:33.359463 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e27f7a0e-7e77-4d61-a393-fe4fde4153d5 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:31:33.368902 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:33.373585 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 req-5e22e240-385c-4c90-98df-d3522600c217 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Unset dirty status for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:33.374939 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 req-5e22e240-385c-4c90-98df-d3522600c217 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 932 time: 0.4096498
May 28 14:31:33.395404 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c04de9-b08f-43c4-bc12-8bfbe401f875 req-0c84d1c0-b6c2-44b9-aef6-ef3f84c1079b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:33.399724 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-56c04de9-b08f-43c4-bc12-8bfbe401f875 req-0c84d1c0-b6c2-44b9-aef6-ef3f84c1079b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 943 time: 0.1112492
May 28 14:31:33.410236 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Transition to ACTIVE for port object e27f7a0e-7e77-4d61-a393-fe4fde4153d5 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:31:33.433410 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-eafaeccc-f408-4b6a-8cf0-721f6a260a00 req-ae8a7355-b0cc-4379-b248-3945790624ae tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0504220
May 28 14:31:33.445397 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-56c04de9-b08f-43c4-bc12-8bfbe401f875 req-95ff0e76-9bac-439c-bbe8-df6978afd1af tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426857
May 28 14:31:33.493646 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:33.499320 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:33.685090 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Pushing event updated for resources: {'Port': ['ID=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:33.695427 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:33.715790 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:33.733862 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Attempting to bind port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:31:33.734225 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Attempting to bind port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:31:33.734553 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Attempting to bind port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 on network cf0db8bd-5a73-44bf-9367-58867c9e819f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:31:33.740707 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 on network cf0db8bd-5a73-44bf-9367-58867c9e819f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:31:33.741027 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Attempting to bind port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 on network cf0db8bd-5a73-44bf-9367-58867c9e819f {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:31:33.746052 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 31, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:31:33.746382 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Checking segment: {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:31:33.746760 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Bound using segment: {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:31:33.747178 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Bound port: e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1813f8c2-f7d0-4718-afc9-11b527ec49a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:31:33.747518 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:33.844536 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:31:33.847666 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:31:33.927318 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 39246) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:33.979694 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:33.983704 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4faea29-9978-4210-ba17-836e1232600c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:34.060517 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:34.061138 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:34.062516 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] 10.222.0.90 "PUT /v2.0/ports/e27f7a0e-7e77-4d61-a393-fe4fde4153d5 HTTP/1.1" status: 200  len: 1094 time: 1.4108808
May 28 14:31:34.068832 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:34.072345 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:34.093864 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:34.100116 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] Usage tracker for resource:security_group_rule and tenant:4746574af07243f0bd823726085feb3b is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:34.104721 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:34.107640 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Pushing event updated for resources: {'Port': ['ID=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:34.114581 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:34.114581 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:34.120081 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'status': 'completed', 'code': 200}
May 28 14:31:34.264181 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:34.269679 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-a2669dff-49e3-4d87-9b48-61a06701562d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:34.271209 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-a2669dff-49e3-4d87-9b48-61a06701562d service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1097 time: 0.1247520
May 28 14:31:34.372626 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:34.383606 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3b7cb86b-0913-499b-ba00-6c64b6742c76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:34.441222 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=4746574af07243f0bd823726085feb3b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5127201
May 28 14:31:34.444060 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39254) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:34.459147 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1517f994-744d-469b-91d8-42a1491927db,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:34.464416 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0e80ac01-5431-464d-90f7-791195243f0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:34.467010 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-d409fec8-9e0d-4b3d-958b-e7fc1f94b739 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:34.468537 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-d409fec8-9e0d-4b3d-958b-e7fc1f94b739 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&shared=False HTTP/1.1" status: 200  len: 907 time: 0.1878884
May 28 14:31:34.507690 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:34.544045 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:34.663070 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83465af3-217e-45d2-b67c-3a98470732d9 req-628485a9-2eef-4c0f-841d-ca13730f0930 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:34.664593 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-83465af3-217e-45d2-b67c-3a98470732d9 req-628485a9-2eef-4c0f-841d-ca13730f0930 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 943 time: 0.0954483
May 28 14:31:34.684242 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-23223c20-0914-4a75-b32a-2ed022ca078b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:34.685666 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1fe2abf2-e75f-4f69-acf4-09c298b2e8ff req-23223c20-0914-4a75-b32a-2ed022ca078b service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2029748
May 28 14:31:34.700550 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e req-1df74c62-156c-4ede-92ad-f8a1c7fbc2f1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:34.701999 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e req-1df74c62-156c-4ede-92ad-f8a1c7fbc2f1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.1392083
May 28 14:31:34.710988 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-83465af3-217e-45d2-b67c-3a98470732d9 req-d8903f06-3e3a-4af9-960a-b6aae16d45bf tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404212
May 28 14:31:34.729726 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:34.736777 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6b0fde36-3c6e-4176-bfd0-2abe1aabb533 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:34.749938 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1517f994-744d-469b-91d8-42a1491927db,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:34.753785 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:34.755740 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/1517f994-744d-469b-91d8-42a1491927db HTTP/1.1" status: 204  len: 168 time: 0.3106291
May 28 14:31:34.760847 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.761365 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.761799 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.762234 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.762661 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.763087 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.763511 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.763956 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.764382 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.764806 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.765228 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.765651 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:31:34.768748 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:34.789306 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3350134e-8f77-42d8-8e9d-a4d9a1c6904e req-f385ee7c-d998-4fb2-812a-669b380fcfd7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0799079
May 28 14:31:34.826010 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-cae1fa86-88bf-42ca-9479-001377c930b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:34.827513 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-cae1fa86-88bf-42ca-9479-001377c930b0 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1097 time: 0.0847528
May 28 14:31:34.901764 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-30349dbe-5a98-43d3-a0ac-57dea97cda56 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5 HTTP/1.1" status: 200  len: 217 time: 0.0660965
May 28 14:31:34.966581 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-eb012c25-854d-45e2-9d0d-95e310dc68a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:34.967949 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-eb012c25-854d-45e2-9d0d-95e310dc68a6 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4a437a5e-a3c1-4c29-a8be-fade6c84b5f4 HTTP/1.1" status: 200  len: 845 time: 0.0581691
May 28 14:31:35.057535 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-deaf623f-ed39-4136-a7f6-bdbec5357b0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:35.059045 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-deaf623f-ed39-4136-a7f6-bdbec5357b0c service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf0db8bd-5a73-44bf-9367-58867c9e819f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0823946
May 28 14:31:35.196277 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-c29c7187-4195-4f14-a5e0-6f9c3c147e07 service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1297495
May 28 14:31:35.207432 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device a1d19f37-64ae-4f18-a8f2-79559df44a3b details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:31:35.365399 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port a1d19f37-64ae-4f18-a8f2-79559df44a3b, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:35.381634 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 867, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:31:35.444586 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cc4828ce-d05f-4dcd-b4b7-1200744f28a9 req-92f41bcf-fbbe-4b37-9208-c65befad3ccf service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2413590
May 28 14:31:35.447919 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:35.466171 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a1d19f37-64ae-4f18-a8f2-79559df44a3b {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:31:35.482142 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port a1d19f37-64ae-4f18-a8f2-79559df44a3b, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:35.546857 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:35.704738 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:35.706524 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-4306e0b0-923c-4d90-9607-1dfd619570e0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:35.773811 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=a1d19f37-64ae-4f18-a8f2-79559df44a3b,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:35.776909 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:35.909757 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e063ae7a-6ec2-4cae-a506-4777a61833e4 req-efbff426-3d44-4bd4-8266-1ad6f7866a17 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:35.911203 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e063ae7a-6ec2-4cae-a506-4777a61833e4 req-efbff426-3d44-4bd4-8266-1ad6f7866a17 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 944 time: 0.0828817
May 28 14:31:35.960886 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e063ae7a-6ec2-4cae-a506-4777a61833e4 req-5885559b-0c34-40dd-96f2-cd60a4ab8d5b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0439408
May 28 14:31:36.062551 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80db9b66-d4d8-44c7-aa03-b200283f762a req-b6ca7e75-e66f-4342-ae08-6d471ff304a8 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:36.064612 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-80db9b66-d4d8-44c7-aa03-b200283f762a req-b6ca7e75-e66f-4342-ae08-6d471ff304a8 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.1651940
May 28 14:31:36.109344 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-80db9b66-d4d8-44c7-aa03-b200283f762a req-e216ae39-d640-4ff3-93c2-e3b72095d097 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0384381
May 28 14:31:36.404907 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['a1d19f37-64ae-4f18-a8f2-79559df44a3b'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:31:37.154991 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42a8832-bb51-44d6-9e96-4816310d1f93 req-1b3772e8-479b-4303-a335-bd287ea6dadc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:37.156608 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a42a8832-bb51-44d6-9e96-4816310d1f93 req-1b3772e8-479b-4303-a335-bd287ea6dadc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 944 time: 0.0848241
May 28 14:31:37.203526 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a42a8832-bb51-44d6-9e96-4816310d1f93 req-10387be8-58e1-4ff0-8df0-a737ef819fd0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413134
May 28 14:31:37.299249 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8320b661-5224-4f1e-9711-8b9bc95b1b36 req-fc68ec81-3de4-490b-aaca-1a0820145547 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:37.301076 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8320b661-5224-4f1e-9711-8b9bc95b1b36 req-fc68ec81-3de4-490b-aaca-1a0820145547 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0830710
May 28 14:31:37.346335 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8320b661-5224-4f1e-9711-8b9bc95b1b36 req-a55a5b11-0282-47cd-a1ae-da84b68277b8 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393507
May 28 14:31:38.384017 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 req-a3b3f3ae-f7df-4b1f-ad92-a52df0e9c39e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:38.385454 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 req-a3b3f3ae-f7df-4b1f-ad92-a52df0e9c39e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 944 time: 0.0781493
May 28 14:31:38.434391 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-14e7ff57-6a54-4e74-9e20-62cdfb6eb7e2 req-d7ec3f08-f38b-4eef-bb56-4977d0246a21 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419831
May 28 14:31:38.550461 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0eae71c-1b72-4473-b672-c7cb6be88265 req-05e88629-24fa-4149-99e5-f8eca4c0a29c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:38.552631 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b0eae71c-1b72-4473-b672-c7cb6be88265 req-05e88629-24fa-4149-99e5-f8eca4c0a29c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0815997
May 28 14:31:38.597264 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b0eae71c-1b72-4473-b672-c7cb6be88265 req-89413a9f-74cb-4618-9e8a-8600e17689b2 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393357
May 28 14:31:38.924392 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-13ec5f52-821d-4e93-8b9f-253d07ce83d4 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1793117328&fields=id&tenant_id=cf7193774c754e07a6f683666ab4addf HTTP/1.1" status: 200  len: 267 time: 0.0424325
May 28 14:31:39.005845 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-0883266c-6fb6-40a5-bda4-15f1904757c7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:39.007271 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-0883266c-6fb6-40a5-bda4-15f1904757c7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 985 time: 0.0775445
May 28 14:31:39.017674 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Request body: {'port': {'security_groups': ['978436a2-dde3-4072-8794-d45c60dfdcd1']}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:39.136516 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:39.222834 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device a1d19f37-64ae-4f18-a8f2-79559df44a3b up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:31:39.367578 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port a1d19f37-64ae-4f18-a8f2-79559df44a3b completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:31:39.371789 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] For port 164fd7c8-7a57-4285-93ef-c3fdabceb8be, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:39.372707 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port a1d19f37-64ae-4f18-a8f2-79559df44a3b triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:31:39.373385 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:39.396235 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:39.464025 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:39.470623 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-36878882-83f9-471f-8c32-e5d0717fd948 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:39.479759 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['164fd7c8-7a57-4285-93ef-c3fdabceb8be'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:31:39.542486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:39.543423 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:39.548083 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-964ccb51-c176-4a13-b6dc-11a82054ea42 req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "PUT /v2.0/ports/164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 943 time: 0.5346854
May 28 14:31:39.548857 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:39.556921 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:39.563703 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39334) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:39.636705 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port a1d19f37-64ae-4f18-a8f2-79559df44a3b, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:39.640406 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:39.653647 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['164fd7c8-7a57-4285-93ef-c3fdabceb8be'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:31:39.654359 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'status': 'completed', 'code': 200}
May 28 14:31:39.661497 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fad7796-dadc-4f70-8c58-531a6abd0638 req-2045c26d-08b0-4e63-8ef5-a4b112aa4c1c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:39.663138 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9fad7796-dadc-4f70-8c58-531a6abd0638 req-2045c26d-08b0-4e63-8ef5-a4b112aa4c1c tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 944 time: 0.1172023
May 28 14:31:39.694950 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event updated for resources: {'Port': ['ID=164fd7c8-7a57-4285-93ef-c3fdabceb8be,revision_number=7']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:39.722469 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7076e95a-c9f2-415d-a115-1a7782bfe0aa tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:39.766361 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:39.784257 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:39.796410 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec407725-1446-4d2e-a58a-ce5df2425783 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:39.834785 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9fad7796-dadc-4f70-8c58-531a6abd0638 req-2b386ee1-665a-4afc-a517-2397a3bfb4f9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0896819
May 28 14:31:39.871610 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-12657b3c-cf3a-47f8-95fe-3209914a0022 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:39.877859 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-12657b3c-cf3a-47f8-95fe-3209914a0022 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=cf7193774c754e07a6f683666ab4addf&device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1099 time: 0.2135091
May 28 14:31:39.897600 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec407725-1446-4d2e-a58a-ce5df2425783 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:39.966251 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-b0b88a63-6233-4eb1-880a-8fbc7e33ea77 None None] Provisioning complete for port 164fd7c8-7a57-4285-93ef-c3fdabceb8be triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:31:39.966626 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b0b88a63-6233-4eb1-880a-8fbc7e33ea77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:40.003842 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'code': 200}
May 28 14:31:40.004199 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dcb9358-3729-4a15-80cd-acc34e88eb94 req-48a82060-1223-46ba-9990-d65ea21e0e84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:40.006705 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9dcb9358-3729-4a15-80cd-acc34e88eb94 req-48a82060-1223-46ba-9990-d65ea21e0e84 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.1556504
May 28 14:31:40.058391 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=a1d19f37-64ae-4f18-a8f2-79559df44a3b,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:40.073931 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-96507495-8193-478e-bf8b-60aae356d4f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:40.075386 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-96507495-8193-478e-bf8b-60aae356d4f1 service neutron] 10.222.0.90 "GET /v2.0/networks?id=780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 200  len: 915 time: 0.1896901
May 28 14:31:40.082159 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.299s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:40.085037 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9dcb9358-3729-4a15-80cd-acc34e88eb94 req-227cdb9b-4ce5-4102-a68c-7ad8bcd46d36 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0719781
May 28 14:31:40.164353 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec407725-1446-4d2e-a58a-ce5df2425783 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:40.169470 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-b8ca36af-506f-4242-a1c2-02d77bb0d16f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:40.186257 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec407725-1446-4d2e-a58a-ce5df2425783 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d863428-3f5e-4b80-a607-bbb4325e640a,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:40.195991 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ec407725-1446-4d2e-a58a-ce5df2425783 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:40.203704 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-3fbf6ba4-f0c0-4c65-8048-2330e877d88b service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 1002 time: 0.1192286
May 28 14:31:40.295881 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-395f730e-fdca-4a05-8097-d70713ab017a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:40.297328 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-395f730e-fdca-4a05-8097-d70713ab017a service neutron] 10.222.0.90 "GET /v2.0/subnets?id=31bcc630-98a7-46cc-9928-64d7da56d404 HTTP/1.1" status: 200  len: 853 time: 0.0858014
May 28 14:31:40.343423 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-ec407725-1446-4d2e-a58a-ce5df2425783 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:40.344577 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-ec407725-1446-4d2e-a58a-ce5df2425783 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "DELETE /v2.0/security-groups/3d863428-3f5e-4b80-a607-bbb4325e640a HTTP/1.1" status: 204  len: 168 time: 0.7752421
May 28 14:31:40.347940 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39348) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:40.375262 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-4fd7de62-dd55-487b-bbf3-544f484fbc5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:40.376771 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-4fd7de62-dd55-487b-bbf3-544f484fbc5e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=780506d2-6c05-4b1f-af1f-a4a3d627ec86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0725923
May 28 14:31:40.583771 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-20884bdc-4180-4d5c-bb24-802357d5505d service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1986470
May 28 14:31:40.592930 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f16136-5b7f-46e5-b795-e5524b50ac0b req-1fc1f068-917e-4e68-b04c-3215142dd4db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:40.594383 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c6f16136-5b7f-46e5-b795-e5524b50ac0b req-1fc1f068-917e-4e68-b04c-3215142dd4db service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 1098 time: 0.1310227
May 28 14:31:40.657303 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Deleting port 56f11a11-b80a-4b90-a0b2-953207708e33 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:31:40.657940 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:40.720610 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c6f16136-5b7f-46e5-b795-e5524b50ac0b req-ba013851-2dc7-4deb-b8c2-e6bfa2929bc8 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1048558
May 28 14:31:40.760518 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f07072ee-4550-43fc-90ba-ae469f2b2803 req-3c8f5c6a-cd46-48fa-8fc6-b46c5691340e service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1651545
May 28 14:31:40.781589 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:40.781919 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:41.004559 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling delete_port for 56f11a11-b80a-4b90-a0b2-953207708e33 owned by network:floatingip {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:31:41.041186 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b70ec0bc-0471-46c8-a765-ccde80e64f8e req-95572c43-deed-437a-923c-3ab87065767d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:41.043088 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b70ec0bc-0471-46c8-a765-ccde80e64f8e req-95572c43-deed-437a-923c-3ab87065767d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.0887656
May 28 14:31:41.093798 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b70ec0bc-0471-46c8-a765-ccde80e64f8e req-c6866489-d6dd-4861-8f3f-cacfab18144b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390773
May 28 14:31:41.280381 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e req-a7e04885-fd13-440b-8202-165fe6fe4e37 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:41.281985 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e req-a7e04885-fd13-440b-8202-165fe6fe4e37 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0868509
May 28 14:31:41.289474 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:41.293425 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:41.330119 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-80a0f0c1-e8fd-4def-a5c0-46a465ba2b0e req-6b24b37c-80e0-4995-a71c-74be8e3b95d1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423775
May 28 14:31:41.340850 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event deleted for resources: {'Port': ['ID=56f11a11-b80a-4b90-a0b2-953207708e33,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:41.344057 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:41.434824 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks [] for floatingip, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:41.435147 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.l3_db [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Floating IP 4f96cf61-8849-454f-9454-827121621f00 disassociated (deleted). External IP: 172.27.3.243, port: 164fd7c8-7a57-4285-93ef-c3fdabceb8be.
May 28 14:31:41.787452 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Router 68f2234d-46e9-4ac9-862b-d0d654ece63d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:31:41.960106 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:31:41.969401 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] Sync routers for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:31:41.978618 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:41.979276 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2746c10>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:42.083407 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:42.146022 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "DELETE /v2.0/floatingips/4f96cf61-8849-454f-9454-827121621f00 HTTP/1.1" status: 204  len: 168 time: 1.7968473
May 28 14:31:42.146742 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:42.169644 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:42.289660 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0381605a-8d81-49c7-a857-8b162005d0bd req-fcf0b69c-c39c-46d4-8347-43f17cdb0ca7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:42.292490 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0381605a-8d81-49c7-a857-8b162005d0bd req-fcf0b69c-c39c-46d4-8347-43f17cdb0ca7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.0878713
May 28 14:31:42.341482 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0381605a-8d81-49c7-a857-8b162005d0bd req-839cc0e5-8678-4775-8394-80c3566c57ab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445864
May 28 14:31:42.397509 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'status': 'completed', 'code': 200}
May 28 14:31:42.498383 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2746c10>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '4b557829-b439-4d08-8b5d-bd878143e67f', 'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'mac_address': 'fa:16:3e:db:9f:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:00Z', 'updated_at': '2021-05-28T14:26:07Z', 'revision_number': 5, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'subnets': [{'id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:42.502261 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] Checking router: 68f2234d-46e9-4ac9-862b-d0d654ece63d for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:31:42.512016 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:42.512524 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2746c10>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:42.692862 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:42.888179 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cb76db-6928-424b-9c57-8d6ce3790fe9 req-8ecdb6a7-9fa1-4d85-a155-29472d99286e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:42.889791 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98cb76db-6928-424b-9c57-8d6ce3790fe9 req-8ecdb6a7-9fa1-4d85-a155-29472d99286e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0870779
May 28 14:31:42.940182 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-98cb76db-6928-424b-9c57-8d6ce3790fe9 req-a3d322fd-0bb2-4551-a22a-4ef73b8f4414 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437191
May 28 14:31:43.023418 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2746c10>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '4b557829-b439-4d08-8b5d-bd878143e67f', 'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'mac_address': 'fa:16:3e:db:9f:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:00Z', 'updated_at': '2021-05-28T14:26:07Z', 'revision_number': 5, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'subnets': [{'id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:43.027530 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5a9313b-fc96-42a0-ad39-7c665e7ff235 None None] The sync data for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi is: [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:26:02Z', 'revision_number': 4, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '4b557829-b439-4d08-8b5d-bd878143e67f', 'name': '', 'network_id': '780506d2-6c05-4b1f-af1f-a4a3d627ec86', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'mac_address': 'fa:16:3e:db:9f:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:00Z', 'updated_at': '2021-05-28T14:26:07Z', 'revision_number': 5, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'subnets': [{'id': '31bcc630-98a7-46cc-9928-64d7da56d404', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:31:43.232529 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5386ff0a-fb84-4dfd-9e46-4ddb7f0ce110 None None] New status for floating IP 4f96cf61-8849-454f-9454-827121621f00: DOWN {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:31:43.529571 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0e74f35-a0c1-47f7-b71e-a989ce318fae req-d7fb4b33-20fc-479d-ba9d-456ec9967da4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:43.530998 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f0e74f35-a0c1-47f7-b71e-a989ce318fae req-d7fb4b33-20fc-479d-ba9d-456ec9967da4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.0780199
May 28 14:31:43.669689 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f0e74f35-a0c1-47f7-b71e-a989ce318fae req-250b9ac6-9170-4b11-a9d7-cbd7f878eb2d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1329749
May 28 14:31:44.127073 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e8c60bf-6264-403b-9161-e6ca149a79dd req-a496844e-61d4-4a3d-8816-926d5450c94f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:44.127073 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8e8c60bf-6264-403b-9161-e6ca149a79dd req-a496844e-61d4-4a3d-8816-926d5450c94f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0782456
May 28 14:31:44.170892 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8e8c60bf-6264-403b-9161-e6ca149a79dd req-b818dfdf-5526-456e-bc18-5079d9a3e082 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397558
May 28 14:31:44.857120 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 req-618b8e8d-8a6c-4dfd-8d73-5f9f0d09695f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:44.858568 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 req-618b8e8d-8a6c-4dfd-8d73-5f9f0d09695f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.0856080
May 28 14:31:44.901868 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0c59e4ab-3df4-45c7-8e56-0789c65e8b07 req-7e1ea5d7-38da-4c80-85f1-592ad7d7859a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0376091
May 28 14:31:45.424427 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 req-0a524d13-98c5-4e79-9320-04b7c9032d68 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:45.425796 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 req-0a524d13-98c5-4e79-9320-04b7c9032d68 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.1457562
May 28 14:31:45.427837 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-7d9554aa-2fe4-4912-922c-2e48d640fbae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:45.432673 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-7d9554aa-2fe4-4912-922c-2e48d640fbae service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=cf7193774c754e07a6f683666ab4addf&device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 1099 time: 0.1035876
May 28 14:31:45.558650 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-45a34a2c-b9a4-4eb1-b5b3-8be20f56d263 req-41e4c36d-2fd1-4956-a035-477105fcb06f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1267722
May 28 14:31:45.602350 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-5f4e67cc-51e8-43a3-8a6f-1d5ed387484f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:45.603806 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-5f4e67cc-51e8-43a3-8a6f-1d5ed387484f service neutron] 10.222.0.90 "GET /v2.0/networks?id=780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 200  len: 915 time: 0.1573157
May 28 14:31:45.680760 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-2c03f6fc-4c75-458d-9f3c-c1449f2912b4 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 200  len: 217 time: 0.0676179
May 28 14:31:45.742688 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-aa395b6f-9049-4713-9c6a-1962deaa85bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:45.744111 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-aa395b6f-9049-4713-9c6a-1962deaa85bb service neutron] 10.222.0.90 "GET /v2.0/subnets?id=31bcc630-98a7-46cc-9928-64d7da56d404 HTTP/1.1" status: 200  len: 853 time: 0.0573370
May 28 14:31:45.841016 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-82d74ae9-297f-47fb-b419-9d63bf9e7cd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:45.842508 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-82d74ae9-297f-47fb-b419-9d63bf9e7cd9 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=780506d2-6c05-4b1f-af1f-a4a3d627ec86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0772378
May 28 14:31:45.977714 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-bbe5beeb-6d9f-419d-8017-05156422a433 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1274996
May 28 14:31:46.173228 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1d56c353-b905-45c8-ac3c-60dc50328b57 req-fe065ade-6bc9-4fba-9a25-5d9be60b6f86 service neutron] 10.222.0.90 "GET /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1861498
May 28 14:31:46.186111 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-845cebbf-7331-464b-b8e1-e745688fb567 req-e5f9a359-713a-4985-8e9b-068db438c923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:46.187611 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-845cebbf-7331-464b-b8e1-e745688fb567 req-e5f9a359-713a-4985-8e9b-068db438c923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.1772654
May 28 14:31:46.234353 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-845cebbf-7331-464b-b8e1-e745688fb567 req-74683433-20d4-43a8-8e7a-89e87730463d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404465
May 28 14:31:46.763085 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9a426a-7dd5-4aea-989a-847115379827 req-b627f2ad-f9c9-45d1-90f0-d813bf252cb0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:46.764593 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cd9a426a-7dd5-4aea-989a-847115379827 req-b627f2ad-f9c9-45d1-90f0-d813bf252cb0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0859509
May 28 14:31:46.812299 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cd9a426a-7dd5-4aea-989a-847115379827 req-9c63f79e-bc3a-48fa-9933-118dfbde1aee tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406387
May 28 14:31:47.245664 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device e27f7a0e-7e77-4d61-a393-fe4fde4153d5 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:31:47.384083 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:47.397989 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'port_id': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'mac_address': 'fa:16:3e:01:e1:b6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 880, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:31:47.419861 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af4e710f-7db7-4298-b288-790b7b27d957 req-b34b04e6-a54b-48e4-b3c0-1ed91e1bd218 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:47.421362 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-af4e710f-7db7-4298-b288-790b7b27d957 req-b34b04e6-a54b-48e4-b3c0-1ed91e1bd218 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.0811341
May 28 14:31:47.467108 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-af4e710f-7db7-4298-b288-790b7b27d957 req-05d36816-2b7c-49d2-843d-ab34d1b16923 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394328
May 28 14:31:47.501132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:47.518122 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e27f7a0e-7e77-4d61-a393-fe4fde4153d5 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:31:47.535089 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:47.615328 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:47.617203 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:47.660242 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c001614-fe05-458d-bba4-1c52072b8385 req-0f0e2c14-689b-440e-baa0-147717258196 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:47.661763 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7c001614-fe05-458d-bba4-1c52072b8385 req-0f0e2c14-689b-440e-baa0-147717258196 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.0861959
May 28 14:31:47.682601 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:47.685682 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:47.708652 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7c001614-fe05-458d-bba4-1c52072b8385 req-ab5a0554-aab8-43a7-830f-6f5d99a06d5e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411398
May 28 14:31:47.731900 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 39418) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:47.803822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7e5b6f6-424b-4030-a176-f26c615cc9bc tempest-TestVolumeBootPattern-2072041258 tempest-TestVolumeBootPattern-2072041258-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:47.805355 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-e7e5b6f6-424b-4030-a176-f26c615cc9bc tempest-TestVolumeBootPattern-2072041258 tempest-TestVolumeBootPattern-2072041258-project-admin] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 1093 time: 0.0725431
May 28 14:31:47.808312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 39424) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:47.813702 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'floatingip': {'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address': '172.20.0.9'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:47.820126 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:47.824322 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:floatingip and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:47.827466 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:47.834720 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:47.921350 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:47.984200 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['e27f7a0e-7e77-4d61-a393-fe4fde4153d5'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:31:48.122904 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 req-5006eb18-57de-4309-9326-7da3e48b1ed8 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:48.124416 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 req-5006eb18-57de-4309-9326-7da3e48b1ed8 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 945 time: 0.1678445
May 28 14:31:48.169898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:48.221913 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-30419ea3-c6d2-4ec7-907c-5fb0b5f1b562 req-97ae1e20-9702-4f91-8377-7e3ccffa66ba tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0909958
May 28 14:31:48.454338 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Allocated IP 172.27.3.50 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/148b4d30-ef9d-407b-a57d-6793093ad35c) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:31:48.603613 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:48.707348 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:48.711306 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-557e88c2-9b99-4096-bfcb-27b29629772b tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:48.775493 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:31:48.778355 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:31:48.782755 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:31:48.818908 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'Port': ['ID=148b4d30-ef9d-407b-a57d-6793093ad35c,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:48.826539 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:49.200491 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:49.278249 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device e27f7a0e-7e77-4d61-a393-fe4fde4153d5 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:31:49.380264 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:49.420307 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c req-60df2194-4f67-4be9-b867-eeb340cb4229 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:49.421758 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c req-60df2194-4f67-4be9-b867-eeb340cb4229 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 945 time: 0.0885062
May 28 14:31:49.437809 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:31:49.444268 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:31:49.447772 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:49.467701 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7e4fefe5-17cf-4bbe-90e2-b4203ba4022c req-352ab8c6-6737-49f6-a7ed-e049546d7414 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393300
May 28 14:31:49.535852 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:31:49.567405 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:49.594902 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:49.603427 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:49.605101 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:49.646025 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'code': 200}
May 28 14:31:49.706400 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:49.711304 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e135b2d5-8a4d-4519-8c97-ac6ccf47d6fb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:49.717890 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:49.720711 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:49.791368 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:49.794471 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:49.841383 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'Port': ['ID=148b4d30-ef9d-407b-a57d-6793093ad35c,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:49.846133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:49.847634 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:50.022866 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.l3_db [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Floating IP e141c6a5-bc74-487a-be63-addcf8e60750 associated. External IP: 172.27.3.50, port: a1d19f37-64ae-4f18-a8f2-79559df44a3b.
May 28 14:31:50.248085 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39462) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:50.353149 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757fb8b0-3860-415e-b16e-58f0af5e4bc2 req-669b4aee-f97d-42ce-b48f-c3b2ffc000ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:50.354601 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-757fb8b0-3860-415e-b16e-58f0af5e4bc2 req-669b4aee-f97d-42ce-b48f-c3b2ffc000ab service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1099 time: 0.2822049
May 28 14:31:50.370479 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:50.394504 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:50.394504 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] Usage tracker for resource:security_group_rule and tenant:2dd8e3abf134418285a439cfcb506d1c is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:50.396668 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:50.402720 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:50.474858 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-757fb8b0-3860-415e-b16e-58f0af5e4bc2 req-fb55beb1-0d99-4c2d-9802-965df4125ca9 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0685921
May 28 14:31:50.492479 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:50.594956 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:50.603836 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-30f9ca3a-27b1-4a5a-8fc0-07fc38cdc69d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:50.626504 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Router 0cb62432-a4fe-4ba8-9099-f616594e4211 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:31:50.646857 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=2dd8e3abf134418285a439cfcb506d1c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3976390
May 28 14:31:50.648462 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b50fd352-f09b-402b-9090-46758ae3af37,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:50.650702 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39474) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:50.653076 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5b2ad35f-ffac-4d92-90a9-fcc080f5fb90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:50.711396 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-becefc52-cc72-42ce-9115-df318b62d814 req-49539b7a-6e08-4f78-ab08-c64894016a3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:50.712900 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-becefc52-cc72-42ce-9115-df318b62d814 req-49539b7a-6e08-4f78-ab08-c64894016a3c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.1861191
May 28 14:31:50.730674 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-74034f8a-1017-4c80-b65d-1bfbe1603d53 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:50.759819 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-74034f8a-1017-4c80-b65d-1bfbe1603d53 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:50.839618 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-becefc52-cc72-42ce-9115-df318b62d814 req-46c5324c-03d7-410d-b51e-7890daeeb111 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1146410
May 28 14:31:50.860742 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:31:50.873550 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] Sync routers for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:31:50.878494 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 req-43717e68-04ac-4cc0-b490-bf0d3e1ba8bb tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:50.880070 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 req-43717e68-04ac-4cc0-b490-bf0d3e1ba8bb tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.1224792
May 28 14:31:50.886471 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:50.887131 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba289e850>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:50.996027 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-74034f8a-1017-4c80-b65d-1bfbe1603d53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:51.003354 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0c6a236c-d404-46eb-b034-4fbec6e26cff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:51.024007 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74034f8a-1017-4c80-b65d-1bfbe1603d53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b50fd352-f09b-402b-9090-46758ae3af37,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:51.024206 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:51.031619 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-74034f8a-1017-4c80-b65d-1bfbe1603d53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:51.039923 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2c01e246-c8df-45d1-9ced-4f1eb0604e51 req-eca2027f-d916-4ea6-9556-aa05d1a49ec1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1513793
May 28 14:31:51.040837 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-74034f8a-1017-4c80-b65d-1bfbe1603d53 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:51.041799 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-74034f8a-1017-4c80-b65d-1bfbe1603d53 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/b50fd352-f09b-402b-9090-46758ae3af37 HTTP/1.1" status: 204  len: 168 time: 0.3902221
May 28 14:31:51.097996 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 3.2886057
May 28 14:31:51.099203 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:51.109970 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:51.271196 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'status': 'completed', 'code': 200}
May 28 14:31:51.376555 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-2a7e3dc3-02b2-4ef6-89ac-48f1bd208099 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:51.378279 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-2a7e3dc3-02b2-4ef6-89ac-48f1bd208099 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 1098 time: 0.0749507
May 28 14:31:51.487017 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba289e850>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'e141c6a5-bc74-487a-be63-addcf8e60750', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:49Z', 'updated_at': '2021-05-28T14:31:49Z', 'revision_number': 0, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:51.492037 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] Checking router: 0cb62432-a4fe-4ba8-9099-f616594e4211 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:31:51.502485 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:51.503346 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba289e850>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:51.537078 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-d5b78d0f-f220-4c17-8f4d-c4e44edb5338 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:51.538535 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-d5b78d0f-f220-4c17-8f4d-c4e44edb5338 service neutron] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 913 time: 0.1392910
May 28 14:31:51.647071 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-d44df37b-7ece-41ac-836f-c797ef5d6548 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b HTTP/1.1" status: 200  len: 998 time: 0.1003640
May 28 14:31:51.713866 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:51.741866 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-b7d5e3d7-2ff9-4bc4-ad15-cab281dfc477 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:51.743383 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-b7d5e3d7-2ff9-4bc4-ad15-cab281dfc477 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.0622051
May 28 14:31:51.836549 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-3e4bf493-ef78-4026-8f22-0582b22aa5e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:51.838027 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-3e4bf493-ef78-4026-8f22-0582b22aa5e2 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0849693
May 28 14:31:52.056395 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-a89705c5-df93-4c8b-a776-eaac4fc90971 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2076404
May 28 14:31:52.151411 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba289e850>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'e141c6a5-bc74-487a-be63-addcf8e60750', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:49Z', 'updated_at': '2021-05-28T14:31:49Z', 'revision_number': 0, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:52.155906 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7a7c0a3-4e00-4a18-adcc-41b32ba1b1b4 None None] The sync data for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi is: [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'e141c6a5-bc74-487a-be63-addcf8e60750', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:49Z', 'updated_at': '2021-05-28T14:31:49Z', 'revision_number': 0, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:31:52.160395 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e3713f9-4968-467a-b8ac-8f8ea509cada req-de7d6890-99b6-4849-b769-3275e9f9ef3e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:52.161698 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8e3713f9-4968-467a-b8ac-8f8ea509cada req-de7d6890-99b6-4849-b769-3275e9f9ef3e tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.1952119
May 28 14:31:52.245000 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8e3713f9-4968-467a-b8ac-8f8ea509cada req-489d8c85-be15-4484-877e-93e752336a4d tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0747910
May 28 14:31:52.250507 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9bdc8c33-690c-4e01-8f74-4d29c6590e2e req-cf1a7aa1-c2c7-400e-a8a6-c7cdfa159209 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1875751
May 28 14:31:52.294036 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a9298a7-6596-432f-85d1-0560a9309f9d req-fdae35f3-19ed-45b4-a45b-48f488bef853 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:52.295423 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1a9298a7-6596-432f-85d1-0560a9309f9d req-fdae35f3-19ed-45b4-a45b-48f488bef853 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.1234081
May 28 14:31:52.346614 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1a9298a7-6596-432f-85d1-0560a9309f9d req-bdaa50e0-68c8-4e70-989c-236257683604 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453231
May 28 14:31:52.391497 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a67d9b5f-3d55-455b-9112-79abd1a5213b None None] New status for floating IP e141c6a5-bc74-487a-be63-addcf8e60750: ACTIVE {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:31:52.654867 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cce8864-eea5-4626-9680-d360577d8db2 req-a2564db6-a885-4f7e-8d01-e81bd66f04d1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:52.656292 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8cce8864-eea5-4626-9680-d360577d8db2 req-a2564db6-a885-4f7e-8d01-e81bd66f04d1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.1997266
May 28 14:31:52.702557 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8cce8864-eea5-4626-9680-d360577d8db2 req-e83fcd5c-3ada-4394-b6f1-f4674053cb1e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403361
May 28 14:31:52.726309 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39494) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:52.972541 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-472b94e9-b5e3-452f-85f1-00ded5e2d2d9 tempest-TestShelveInstance-1529817959 tempest-TestShelveInstance-1529817959-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:52.973250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-472b94e9-b5e3-452f-85f1-00ded5e2d2d9 tempest-TestShelveInstance-1529817959 tempest-TestShelveInstance-1529817959-project-admin] Synchronizing usage tracker for tenant:c8294323eb2a41b6875b41f3ee440d11 on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:53.052205 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-472b94e9-b5e3-452f-85f1-00ded5e2d2d9 tempest-TestShelveInstance-1529817959 tempest-TestShelveInstance-1529817959-project-admin] Unset dirty status for tenant:c8294323eb2a41b6875b41f3ee440d11 on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:53.053372 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-472b94e9-b5e3-452f-85f1-00ded5e2d2d9 tempest-TestShelveInstance-1529817959 tempest-TestShelveInstance-1529817959-project-admin] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1094 time: 0.3262024
May 28 14:31:53.056536 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39502) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:53.062146 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Request body: {'floatingip': {'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'port_id': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'fixed_ip_address': '172.20.0.12'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:31:53.068354 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:31:53.072107 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Usage tracker for resource:floatingip and tenant:26daec94fed843c8b74a9ff7d18ecdb5 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:31:53.074910 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:31:53.081056 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:31:53.174620 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for floatingip, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:53.314788 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:53.352199 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-95dc080d-1c79-4d82-ac07-eaaa5acf2dd7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:53.353634 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-95dc080d-1c79-4d82-ac07-eaaa5acf2dd7 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.90 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.0870123
May 28 14:31:53.459094 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Allocated IP 172.27.3.173 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/e45668de-7821-454f-84eb-c28db991adc2) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:31:53.541388 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1293529-f283-4c72-9909-07a9ff09b4c6 req-91c8c8a8-b3bd-41b4-ac99-9778fc74649c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:53.542749 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c1293529-f283-4c72-9909-07a9ff09b4c6 req-91c8c8a8-b3bd-41b4-ac99-9778fc74649c tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 946 time: 0.1874549
May 28 14:31:53.585660 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Deleting port 164fd7c8-7a57-4285-93ef-c3fdabceb8be {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:31:53.585995 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:53.606865 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:53.615001 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c1293529-f283-4c72-9909-07a9ff09b4c6 req-85cf00ce-e606-454c-aca0-855e4f5fe1bb tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/security-groups?id=978436a2-dde3-4072-8794-d45c60dfdcd1&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0647717
May 28 14:31:53.707107 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:53.712038 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-25750ae8-90f7-466c-8cac-495840e0cdde admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:53.729420 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] For port 164fd7c8-7a57-4285-93ef-c3fdabceb8be, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=164fd7c8-7a57-4285-93ef-c3fdabceb8be,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:53.729766 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:53.773428 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:31:53.776290 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:31:53.779986 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:31:53.821243 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'Port': ['ID=e45668de-7821-454f-84eb-c28db991adc2,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:53.829001 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:53.853226 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Calling delete_port for 164fd7c8-7a57-4285-93ef-c3fdabceb8be owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:31:54.046614 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:54.054766 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e0b0d167-8787-4044-aede-ca816d28e24e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:54.058976 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['164fd7c8-7a57-4285-93ef-c3fdabceb8be'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:31:54.102192 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Pushing event deleted for resources: {'Port': ['ID=164fd7c8-7a57-4285-93ef-c3fdabceb8be,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:54.104649 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:54.181160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] No DVR routers for this DVR port 164fd7c8-7a57-4285-93ef-c3fdabceb8be on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:31:54.183867 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:54.188450 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'name': 'network-vif-deleted', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:54.199713 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ab9cab60-f1ae-446b-9a49-ec25fe6b54bd req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.90 "DELETE /v2.0/ports/164fd7c8-7a57-4285-93ef-c3fdabceb8be HTTP/1.1" status: 204  len: 173 time: 0.8134334
May 28 14:31:54.204564 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:54.240174 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4', 'name': 'network-vif-deleted', 'tag': '164fd7c8-7a57-4285-93ef-c3fdabceb8be', 'status': 'completed', 'code': 200}
May 28 14:31:54.407000 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:54.624179 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:54.683466 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:54.688520 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-21eec2a9-f26b-4110-8db5-07839f0be74d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:31:54.838595 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-7757e079-302d-4e55-b770-cb30202ec051 req-e18fb544-58ba-4cc0-8ffe-d1a2c7aed008 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Synchronizing usage tracker for tenant:cf7193774c754e07a6f683666ab4addf on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:31:54.846834 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event updated for resources: {'Port': ['ID=e45668de-7821-454f-84eb-c28db991adc2,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:31:54.854542 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:31:54.863851 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:55.128385 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-7757e079-302d-4e55-b770-cb30202ec051 req-e18fb544-58ba-4cc0-8ffe-d1a2c7aed008 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Unset dirty status for tenant:cf7193774c754e07a6f683666ab4addf on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:31:55.129681 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7757e079-302d-4e55-b770-cb30202ec051 req-e18fb544-58ba-4cc0-8ffe-d1a2c7aed008 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] 10.222.0.59 "GET /v2.0/ports?device_id=0c4e4ba2-20eb-437d-8f0e-1dadf000f4d4 HTTP/1.1" status: 200  len: 210 time: 0.3842192
May 28 14:31:55.139499 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.l3_db [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Floating IP 8452deeb-323d-434e-b8d7-b26984c4ec22 associated. External IP: 172.27.3.173, port: e27f7a0e-7e77-4d61-a393-fe4fde4153d5.
May 28 14:31:55.504521 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Router 094f20c9-a78b-4f13-89ee-236a84d949e7 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:31:55.688299 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:31:55.700543 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] Sync routers for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:31:55.709678 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:55.710298 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba24da460>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:55.809472 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:55.871029 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.8132396
May 28 14:31:55.871635 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:31:55.893236 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:55.924553 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'status': 'completed', 'code': 200}
May 28 14:31:56.032444 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-e470bc88-a9db-4ccd-8fb9-c7ee34bd9e85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:56.033921 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-e470bc88-a9db-4ccd-8fb9-c7ee34bd9e85 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1099 time: 0.0746837
May 28 14:31:56.170864 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-e5adddb3-e881-482f-a29d-582e23fbaaab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:56.172374 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-e5adddb3-e881-482f-a29d-582e23fbaaab service neutron] 10.222.0.90 "GET /v2.0/networks?id=cf0db8bd-5a73-44bf-9367-58867c9e819f HTTP/1.1" status: 200  len: 907 time: 0.1285787
May 28 14:31:56.271834 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba24da460>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '8452deeb-323d-434e-b8d7-b26984c4ec22', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'floating_ip_address': '172.27.3.173', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'port_id': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 611, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'mac_address': 'fa:16:3e:01:e1:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:54Z', 'updated_at': '2021-05-28T14:31:54Z', 'revision_number': 0, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b1668072-a83a-4a97-b60d-54f1d0a5a421', 'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'mac_address': 'fa:16:3e:05:96:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 541, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:40Z', 'updated_at': '2021-05-28T14:30:47Z', 'revision_number': 5, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'subnets': [{'id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:56.277001 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] Checking router: 094f20c9-a78b-4f13-89ee-236a84d949e7 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:31:56.286265 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:31:56.286893 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba24da460>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:56.290048 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-0bf76b84-384c-4540-998f-f1833f01caf5 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5 HTTP/1.1" status: 200  len: 1000 time: 0.1088870
May 28 14:31:56.352212 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-c074dcce-462c-4200-a970-3981e4a1d53a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:56.353661 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-c074dcce-462c-4200-a970-3981e4a1d53a service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4a437a5e-a3c1-4c29-a8be-fade6c84b5f4 HTTP/1.1" status: 200  len: 845 time: 0.0575044
May 28 14:31:56.436343 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-cdec95d5-07de-4cea-bd37-184e14b19ac6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:31:56.438338 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-cdec95d5-07de-4cea-bd37-184e14b19ac6 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf0db8bd-5a73-44bf-9367-58867c9e819f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0781291
May 28 14:31:56.471632 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:31:56.581034 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-f9fb1cc4-9098-46e5-884e-231e295bc3ad service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1325111
May 28 14:31:56.836542 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6881e4e-8792-4cda-a7ed-755dd0e2497d req-00167587-7b39-4038-aff3-c6506d17c2d8 service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2479765
May 28 14:31:56.860136 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba24da460>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '8452deeb-323d-434e-b8d7-b26984c4ec22', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'floating_ip_address': '172.27.3.173', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'port_id': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 611, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'mac_address': 'fa:16:3e:01:e1:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:54Z', 'updated_at': '2021-05-28T14:31:54Z', 'revision_number': 0, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b1668072-a83a-4a97-b60d-54f1d0a5a421', 'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'mac_address': 'fa:16:3e:05:96:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 541, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:40Z', 'updated_at': '2021-05-28T14:30:47Z', 'revision_number': 5, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'subnets': [{'id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:31:56.864284 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d39787e-ba95-40fc-8892-a088685045a8 None None] The sync data for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi is: [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '8452deeb-323d-434e-b8d7-b26984c4ec22', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'floating_ip_address': '172.27.3.173', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'port_id': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 611, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'mac_address': 'fa:16:3e:01:e1:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:54Z', 'updated_at': '2021-05-28T14:31:54Z', 'revision_number': 0, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b1668072-a83a-4a97-b60d-54f1d0a5a421', 'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'mac_address': 'fa:16:3e:05:96:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 541, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:40Z', 'updated_at': '2021-05-28T14:30:47Z', 'revision_number': 5, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'subnets': [{'id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:31:57.050947 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6291847-d331-4ed3-9fd2-5bcc80a371a3 None None] New status for floating IP 8452deeb-323d-434e-b8d7-b26984c4ec22: ACTIVE {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:31:57.296173 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 164fd7c8-7a57-4285-93ef-c3fdabceb8be no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:31:57.333349 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 164fd7c8-7a57-4285-93ef-c3fdabceb8be {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:31:57.333959 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 164fd7c8-7a57-4285-93ef-c3fdabceb8be not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:31:57.926317 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:58.238209 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39572) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:31:58.979749 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-681900'] for router_interface, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:59.387268 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Deleting port 4b557829-b439-4d08-8b5d-bd878143e67f {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:31:59.387985 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:59.508240 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] For port 4b557829-b439-4d08-8b5d-bd878143e67f, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=4b557829-b439-4d08-8b5d-bd878143e67f,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:31:59.508592 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:31:59.631810 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Calling delete_port for 4b557829-b439-4d08-8b5d-bd878143e67f owned by network:router_interface {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:32:00.019996 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:00.023841 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6cbdfcb1-4057-4348-bdb4-84e2a44faac9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:00.051965 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-147ab1ed-77ac-4ac9-9dc7-477ac91aadad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:00.070550 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Pushing event deleted for resources: {'Port': ['ID=4b557829-b439-4d08-8b5d-bd878143e67f,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:00.073012 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:00.339364 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551923', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-685116'] for router_interface, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:00.783382 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Router 68f2234d-46e9-4ac9-862b-d0d654ece63d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:32:00.964472 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:32:00.972700 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] Sync routers for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:32:00.988005 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:32:00.988005 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba22e6dc0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:01.064538 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5cff6d79-a97f-4a39-a4e0-eefdf8929881 admin admin] 10.222.0.59 "PUT /v2.0/routers/68f2234d-46e9-4ac9-862b-d0d654ece63d/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8250649
May 28 14:32:01.070090 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39584) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:01.203694 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:32:01.254764 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks [] for router, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:01.433337 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:01.488332 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba22e6dc0>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117'}], 'enable_snat': True}, 'gw_port_id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:31:59Z', 'revision_number': 5, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port': {'id': '29a95454-108b-456c-bdc1-95ecef6cc5a5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:a3:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.117', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:56Z', 'updated_at': '2021-05-28T14:26:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:01.492118 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] Checking router: 68f2234d-46e9-4ac9-862b-d0d654ece63d for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:32:01.500539 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] Routers {'68f2234d-46e9-4ac9-862b-d0d654ece63d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:32:01.501133 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba22e6dc0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:31:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['68f2234d-46e9-4ac9-862b-d0d654ece63d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:01.578393 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Deleting port 29a95454-108b-456c-bdc1-95ecef6cc5a5 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:32:01.578742 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:01.651273 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] Set router 68f2234d-46e9-4ac9-862b-d0d654ece63d gateway port host: None {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:32:01.708283 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] For port 29a95454-108b-456c-bdc1-95ecef6cc5a5, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=29a95454-108b-456c-bdc1-95ecef6cc5a5,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:32:01.708633 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:01.764860 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba22e6dc0>, [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:32:01Z', 'revision_number': 6, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port_host': None}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:01.769713 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb4ecba1-37ec-4051-9963-4ceb8c1de917 None None] The sync data for ids ['68f2234d-46e9-4ac9-862b-d0d654ece63d'] in dv-cinder-791281-3-iscsi is: [{'id': '68f2234d-46e9-4ac9-862b-d0d654ece63d', 'name': 'tempest-TestMinimumBasicScenario-623751679-router', 'tenant_id': 'cf7193774c754e07a6f683666ab4addf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:55Z', 'updated_at': '2021-05-28T14:32:01Z', 'revision_number': 6, 'project_id': 'cf7193774c754e07a6f683666ab4addf', 'gw_port_host': None}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:32:01.834432 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Calling delete_port for 29a95454-108b-456c-bdc1-95ecef6cc5a5 owned by network:router_gateway {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:32:02.058278 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.062847 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:02.211647 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Pushing event deleted for resources: {'Port': ['ID=29a95454-108b-456c-bdc1-95ecef6cc5a5,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:02.214763 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:02.304679 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-682161'] for router_gateway, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.477507 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-685628', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31078'] for router, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.479683 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.511733 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.542324 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-112ed051-5ccc-4f8c-a7f5-003ed1cf967a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.672116 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-684032'] for router, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.672630 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 68f2234d-46e9-4ac9-862b-d0d654ece63d {{(pid=92694) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 28 14:32:02.685406 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Notify callbacks [] for router, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.686536 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] 10.222.0.59 "DELETE /v2.0/routers/68f2234d-46e9-4ac9-862b-d0d654ece63d HTTP/1.1" status: 204  len: 168 time: 1.6152372
May 28 14:32:02.689236 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39592) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:02.759102 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_v2 [None req-bb4cff3b-3b6c-41b5-bc9b-85ea48459918 admin admin] Deleting subnet 31bcc630-98a7-46cc-9928-64d7da56d404 {{(pid=92694) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:32:02.761390 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bb4cff3b-3b6c-41b5-bc9b-85ea48459918 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.812134 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bb4cff3b-3b6c-41b5-bc9b-85ea48459918 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1655020'] for subnet, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:02.931740 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bb4cff3b-3b6c-41b5-bc9b-85ea48459918 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.113157 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 29a95454-108b-456c-bdc1-95ecef6cc5a5 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:32:03.148521 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 29a95454-108b-456c-bdc1-95ecef6cc5a5 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:32:03.148869 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 29a95454-108b-456c-bdc1-95ecef6cc5a5 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:32:03.149295 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 4b557829-b439-4d08-8b5d-bd878143e67f no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:32:03.181260 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 4b557829-b439-4d08-8b5d-bd878143e67f {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:32:03.181985 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 4b557829-b439-4d08-8b5d-bd878143e67f not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:32:03.271718 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bb4cff3b-3b6c-41b5-bc9b-85ea48459918 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3483512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3521832'] for subnet, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.275933 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-626df0b4-829b-4838-9552-0095dee82f25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:03.308211 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb4cff3b-3b6c-41b5-bc9b-85ea48459918 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=31bcc630-98a7-46cc-9928-64d7da56d404,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:03.311649 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-bb4cff3b-3b6c-41b5-bc9b-85ea48459918 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:03.314808 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-bb4cff3b-3b6c-41b5-bc9b-85ea48459918 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.320547 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-bb4cff3b-3b6c-41b5-bc9b-85ea48459918 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/31bcc630-98a7-46cc-9928-64d7da56d404 HTTP/1.1" status: 204  len: 168 time: 0.6303453
May 28 14:32:03.322459 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03f7966d-08a5-402d-bb3d-38c823d1a734 None None] Network 780506d2-6c05-4b1f-af1f-a4a3d627ec86 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:32:03.323131 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39598) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:03.429045 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.504703 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Deleting port f486e033-b073-48b8-9c5f-d7ad8479d312 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:32:03.505038 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.566498 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] DHCP port deletion for 780506d2-6c05-4b1f-af1f-a4a3d627ec86 request from dv-cinder-791281-3-iscsi {{(pid=92696) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 28 14:32:03.605677 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] For port f486e033-b073-48b8-9c5f-d7ad8479d312, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f486e033-b073-48b8-9c5f-d7ad8479d312,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:32:03.606032 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.630574 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Deleting port f486e033-b073-48b8-9c5f-d7ad8479d312 {{(pid=92696) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:32:03.630950 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.741992 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] For port f486e033-b073-48b8-9c5f-d7ad8479d312, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f486e033-b073-48b8-9c5f-d7ad8479d312,segment=NetworkSegment(5d4a0d84-b33a-4965-b76a-6b4579480439),segment_id=5d4a0d84-b33a-4965-b76a-6b4579480439)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:32:03.742419 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.826537 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Calling delete_port for f486e033-b073-48b8-9c5f-d7ad8479d312 owned by network:dhcp {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:32:03.842346 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.909381 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Calling delete_port for f486e033-b073-48b8-9c5f-d7ad8479d312 owned by network:dhcp {{(pid=92696) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:32:03.943164 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:03.947080 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:03.990557 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Pushing event deleted for resources: {'Port': ['ID=f486e033-b073-48b8-9c5f-d7ad8479d312,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:03.993567 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:03.994347 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] No DVR routers for this DVR port f486e033-b073-48b8-9c5f-d7ad8479d312 on host dv-cinder-791281-3-iscsi {{(pid=92694) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:32:04.035272 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980'] for port, after_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:04.038879 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-91ae324e-a80c-46f1-861e-7eb4d28c3ab3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:04.084129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Pushing event deleted for resources: {'Port': ['ID=f486e033-b073-48b8-9c5f-d7ad8479d312,revision_number=None']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:04.089596 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] No DVR routers for this DVR port f486e033-b073-48b8-9c5f-d7ad8479d312 on host dv-cinder-791281-3-iscsi {{(pid=92696) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:32:04.098092 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.098702 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.099389 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.100062 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.100395 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.100840 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.101161 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.101481 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.101922 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.102246 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.102561 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.104609 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:32:04.108498 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:04.110275 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:04.125238 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba0c8c520>,) {'filters': {'network_id': ['780506d2-6c05-4b1f-af1f-a4a3d627ec86']}} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:04.142466 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0c8c520>, '5d4a0d84-b33a-4965-b76a-6b4579480439') {'for_net_delete': True} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:04.142758 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0c8c520>, '5d4a0d84-b33a-4965-b76a-6b4579480439') {} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:04.154069 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1655015'] for segment, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:04.170204 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:04.177101 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Releasing vlan 857 on physical network physnet1 to pool {{(pid=92694) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:32:04.177478 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3422942'] for segment, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]: Traceback (most recent call last):
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     timer()
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     cb(*args, **kw)
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     return func(*args, **kwargs)
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     self._notify()
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     self.callback(batched_events)
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     event.method(event)
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     return f(self, *a, **k)
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._get(url).json()
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self.request(url, 'GET', **kwargs)
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:32:04.191347 dv-cinder-791281-3-iscsi neutron-server[92694]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:32:04.340215 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:04.343879 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:04.356791 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:04.372669 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Pushing event deleted for resources: {'Network': ['ID=780506d2-6c05-4b1f-af1f-a4a3d627ec86,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:04.377370 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:04.460955 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] 10.222.0.59 "DELETE /v2.0/networks/780506d2-6c05-4b1f-af1f-a4a3d627ec86 HTTP/1.1" status: 204  len: 168 time: 1.1367950
May 28 14:32:04.463882 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39604) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:04.992893 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-681900'] for router_interface, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:05.118903 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f486e033-b073-48b8-9c5f-d7ad8479d312 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:32:05.152772 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: f486e033-b073-48b8-9c5f-d7ad8479d312 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:32:05.153127 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f486e033-b073-48b8-9c5f-d7ad8479d312 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:32:05.348950 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:05.409372 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Deleting port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:32:05.409706 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:05.616161 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] For port 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c,segment=NetworkSegment(383d4e28-523c-4ae9-8c2d-d39a2f2756c4),segment_id=383d4e28-523c-4ae9-8c2d-d39a2f2756c4)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:32:05.616423 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:05.737223 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Calling delete_port for 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c owned by network:router_interface {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:32:05.960059 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:05.963985 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:06.011031 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Pushing event deleted for resources: {'Port': ['ID=8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:06.013437 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:06.287698 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551923', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-685116'] for router_interface, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:06.648207 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Router 0f40bc76-0322-44d2-a3d8-f60c99809582 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:32:06.828253 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:32:06.836507 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] Sync routers for ids ['0f40bc76-0322-44d2-a3d8-f60c99809582'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:32:06.837244 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] 10.222.0.59 "PUT /v2.0/routers/0f40bc76-0322-44d2-a3d8-f60c99809582/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.3723824
May 28 14:32:06.839766 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39614) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:06.847113 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] Routers {'0f40bc76-0322-44d2-a3d8-f60c99809582'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:32:06.847869 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba325a190>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:32:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0f40bc76-0322-44d2-a3d8-f60c99809582'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:07.027842 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] Set router 0f40bc76-0322-44d2-a3d8-f60c99809582 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:32:07.133363 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks [] for router, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:07.317093 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:07.359888 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba325a190>, [{'id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188'}], 'enable_snat': True}, 'gw_port_id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:26:07Z', 'updated_at': '2021-05-28T14:32:05Z', 'revision_number': 5, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'gw_port': {'id': '6f781748-253f-45fc-bd6d-1066450d3a1a', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:87:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:26:09Z', 'updated_at': '2021-05-28T14:26:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:07.363524 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] Checking router: 0f40bc76-0322-44d2-a3d8-f60c99809582 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:32:07.371664 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] Routers {'0f40bc76-0322-44d2-a3d8-f60c99809582'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:32:07.372529 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba325a190>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:32:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0f40bc76-0322-44d2-a3d8-f60c99809582'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:07.483431 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Deleting port 6f781748-253f-45fc-bd6d-1066450d3a1a {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:32:07.484297 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:07.523448 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] Set router 0f40bc76-0322-44d2-a3d8-f60c99809582 gateway port host: None {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:32:07.610659 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] For port 6f781748-253f-45fc-bd6d-1066450d3a1a, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=6f781748-253f-45fc-bd6d-1066450d3a1a,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:32:07.611060 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:07.633561 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba325a190>, [{'id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:26:07Z', 'updated_at': '2021-05-28T14:32:07Z', 'revision_number': 6, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'gw_port_host': None}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:07.637576 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49495732-3057-447c-97e5-ff4956c83cdc None None] The sync data for ids ['0f40bc76-0322-44d2-a3d8-f60c99809582'] in dv-cinder-791281-3-iscsi is: [{'id': '0f40bc76-0322-44d2-a3d8-f60c99809582', 'name': 'tempest-TestMinimumBasicScenario-1005813024-router', 'tenant_id': '0be9be1321f244bc94c24f456fb7c525', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:26:07Z', 'updated_at': '2021-05-28T14:32:07Z', 'revision_number': 6, 'project_id': '0be9be1321f244bc94c24f456fb7c525', 'gw_port_host': None}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:32:07.737457 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Calling delete_port for 6f781748-253f-45fc-bd6d-1066450d3a1a owned by network:router_gateway {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:32:07.957140 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:07.960961 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e36f81ca-d870-4577-b5ff-01d66830f020 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:08.008012 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Pushing event deleted for resources: {'Port': ['ID=6f781748-253f-45fc-bd6d-1066450d3a1a,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:08.010972 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:08.106132 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-682161'] for router_gateway, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:08.289608 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-685628', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31078'] for router, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:08.291903 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:08.469206 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-684032'] for router, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:08.469757 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0f40bc76-0322-44d2-a3d8-f60c99809582 {{(pid=92694) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 28 14:32:08.487197 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] Notify callbacks [] for router, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:08.487197 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-904ecdaf-121f-4208-a951-1444e31c434c admin admin] 10.222.0.59 "DELETE /v2.0/routers/0f40bc76-0322-44d2-a3d8-f60c99809582 HTTP/1.1" status: 204  len: 168 time: 1.6429439
May 28 14:32:08.487990 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 39620) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:08.554286 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-87dd2c8d-6169-4fa4-8519-45681f0c3a79 admin admin] Deleting subnet e337430b-91ab-4713-a867-a6459ba34606 {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:32:08.554286 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-87dd2c8d-6169-4fa4-8519-45681f0c3a79 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:08.601221 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-87dd2c8d-6169-4fa4-8519-45681f0c3a79 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1610776'] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:08.731470 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-87dd2c8d-6169-4fa4-8519-45681f0c3a79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.089149 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-87dd2c8d-6169-4fa4-8519-45681f0c3a79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1635750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1808149'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.096865 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1aafa41d-ea90-47f9-80ec-8fc54ebec647 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:09.115929 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 6f781748-253f-45fc-bd6d-1066450d3a1a no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:32:09.132353 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dd2c8d-6169-4fa4-8519-45681f0c3a79 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e337430b-91ab-4713-a867-a6459ba34606,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:09.134418 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-87dd2c8d-6169-4fa4-8519-45681f0c3a79 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.136963 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-87dd2c8d-6169-4fa4-8519-45681f0c3a79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:09.142616 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-87dd2c8d-6169-4fa4-8519-45681f0c3a79 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/e337430b-91ab-4713-a867-a6459ba34606 HTTP/1.1" status: 204  len: 168 time: 0.6535995
May 28 14:32:09.145440 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 39626) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:09.149280 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddc30a46-7e11-4905-8dd0-4c3f92f93a89 None None] Network 80af2296-81e4-47a9-b767-e8d04b07bbce requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:32:09.168094 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 6f781748-253f-45fc-bd6d-1066450d3a1a {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:32:09.168501 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 6f781748-253f-45fc-bd6d-1066450d3a1a not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:32:09.168870 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:32:09.247605 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:32:09.247957 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 8ef17ed8-f40a-4c26-90c3-fc28e2c44b0c not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:32:09.257468 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.337633 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Deleting port 02ea7bcd-9a38-4a91-99c6-f34511237d89 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:32:09.337875 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.429571 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] DHCP port deletion for 80af2296-81e4-47a9-b767-e8d04b07bbce request from dv-cinder-791281-3-iscsi {{(pid=92696) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 28 14:32:09.442113 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] For port 02ea7bcd-9a38-4a91-99c6-f34511237d89, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=02ea7bcd-9a38-4a91-99c6-f34511237d89,segment=NetworkSegment(383d4e28-523c-4ae9-8c2d-d39a2f2756c4),segment_id=383d4e28-523c-4ae9-8c2d-d39a2f2756c4)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:32:09.442463 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.494106 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] Deleting port 02ea7bcd-9a38-4a91-99c6-f34511237d89 {{(pid=92696) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:32:09.494467 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.565343 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Calling delete_port for 02ea7bcd-9a38-4a91-99c6-f34511237d89 owned by network:dhcp {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:32:09.596326 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] For port 02ea7bcd-9a38-4a91-99c6-f34511237d89, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=02ea7bcd-9a38-4a91-99c6-f34511237d89,segment=NetworkSegment(383d4e28-523c-4ae9-8c2d-d39a2f2756c4),segment_id=383d4e28-523c-4ae9-8c2d-d39a2f2756c4)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:32:09.596642 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.711124 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.715979 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cdf94d0c-bc48-4aae-bf7a-47e83fbbf48f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:09.719491 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] Calling delete_port for 02ea7bcd-9a38-4a91-99c6-f34511237d89 owned by network:dhcp {{(pid=92696) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:32:09.764214 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980'] for port, after_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.766144 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] No DVR routers for this DVR port 02ea7bcd-9a38-4a91-99c6-f34511237d89 on host dv-cinder-791281-3-iscsi {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:32:09.768024 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:09.792609 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Pushing event deleted for resources: {'Port': ['ID=02ea7bcd-9a38-4a91-99c6-f34511237d89,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:09.795234 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:09.812416 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] Pushing event deleted for resources: {'Port': ['ID=02ea7bcd-9a38-4a91-99c6-f34511237d89,revision_number=None']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:09.817150 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:09.823246 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] No DVR routers for this DVR port 02ea7bcd-9a38-4a91-99c6-f34511237d89 on host dv-cinder-791281-3-iscsi {{(pid=92696) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:32:09.896684 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.909101 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba0e4edf0>,) {'filters': {'network_id': ['80af2296-81e4-47a9-b767-e8d04b07bbce']}} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:09.920574 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0e4edf0>, '383d4e28-523c-4ae9-8c2d-d39a2f2756c4') {'for_net_delete': True} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:09.920890 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba0e4edf0>, '383d4e28-523c-4ae9-8c2d-d39a2f2756c4') {} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:32:09.932139 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1610771'] for segment, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.948363 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.955280 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Releasing vlan 897 on physical network physnet1 to pool {{(pid=92695) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:32:09.956147 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1697792'] for segment, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]: Traceback (most recent call last):
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     timer()
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     cb(*args, **kw)
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     return func(*args, **kwargs)
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     self._notify()
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     self.callback(batched_events)
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     event.method(event)
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     return f(self, *a, **k)
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._get(url).json()
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self.request(url, 'GET', **kwargs)
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:32:09.968743 dv-cinder-791281-3-iscsi neutron-server[92695]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:32:10.114106 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:10.117976 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b1f0a106-f6aa-4462-b1a3-7dde02073970 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:10.132432 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:10.143280 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Pushing event deleted for resources: {'Network': ['ID=80af2296-81e4-47a9-b767-e8d04b07bbce,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:10.146293 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:10.148788 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-0c8f86b3-b919-4fe5-872e-752cf2b1b70a admin admin] 10.222.0.59 "DELETE /v2.0/networks/80af2296-81e4-47a9-b767-e8d04b07bbce HTTP/1.1" status: 204  len: 168 time: 1.0014484
May 28 14:32:10.494338 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 39636) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:10.542688 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-9147a2a3-866f-4432-a344-b782ea0b6fe6 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=cf7193774c754e07a6f683666ab4addf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0471489
May 28 14:32:10.545471 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 39640) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:10.603094 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0e8e221b-6ff6-4742-a788-5197b92d7d90 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:10.628822 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0e8e221b-6ff6-4742-a788-5197b92d7d90 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:10.768574 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0e8e221b-6ff6-4742-a788-5197b92d7d90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:10.772394 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-85850ed0-05b5-4cc6-94bc-97775c3f8f0e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:10.786376 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e8e221b-6ff6-4742-a788-5197b92d7d90 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=978436a2-dde3-4072-8794-d45c60dfdcd1,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:10.788931 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0e8e221b-6ff6-4742-a788-5197b92d7d90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:10.794665 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0e8e221b-6ff6-4742-a788-5197b92d7d90 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:10.795860 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-0e8e221b-6ff6-4742-a788-5197b92d7d90 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/978436a2-dde3-4072-8794-d45c60dfdcd1 HTTP/1.1" status: 204  len: 168 time: 0.2493858
May 28 14:32:11.121406 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 02ea7bcd-9a38-4a91-99c6-f34511237d89 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:32:11.179904 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 02ea7bcd-9a38-4a91-99c6-f34511237d89 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:32:11.180494 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 02ea7bcd-9a38-4a91-99c6-f34511237d89 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:32:11.539425 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39650) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:11.590907 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-bb00f484-aa93-46eb-833b-c427a7b09030 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=0be9be1321f244bc94c24f456fb7c525&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0502067
May 28 14:32:11.593776 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39654) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:32:11.653770 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-900eb025-424b-4891-815a-e8ee4ff6cfef admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:11.679948 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-900eb025-424b-4891-815a-e8ee4ff6cfef admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:11.860209 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-900eb025-424b-4891-815a-e8ee4ff6cfef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:11.864006 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ce300bdc-e6de-4f1e-8144-bca1a0c8028b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:32:11.875901 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-900eb025-424b-4891-815a-e8ee4ff6cfef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ee698d3-c038-4ff2-ac70-843152d2a174,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:32:11.884020 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-900eb025-424b-4891-815a-e8ee4ff6cfef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:32:11.884020 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-900eb025-424b-4891-815a-e8ee4ff6cfef admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:11.884020 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-900eb025-424b-4891-815a-e8ee4ff6cfef admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/2ee698d3-c038-4ff2-ac70-843152d2a174 HTTP/1.1" status: 204  len: 168 time: 0.2890673
May 28 14:32:26.534580 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:32:27.921896 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:30.012964 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-69746dd7-3f5e-4205-ac41-06b4a0e14243 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:32.532806 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:32.549523 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7e301135-4f74-45fa-9b8a-f2075d8c06e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:33.639054 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-59c2aa39-9f0e-436c-a8fa-55d15cef22ff service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1620383
May 28 14:32:33.771169 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:33.773412 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-6c585fae-abad-4db5-8f4c-5a252d0fefb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:32:33.774845 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-6c585fae-abad-4db5-8f4c-5a252d0fefb8 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 1098 time: 0.0690236
May 28 14:32:33.916555 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-cb5b85f1-050e-44d4-ac0d-e4f31750a702 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:32:33.918003 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-cb5b85f1-050e-44d4-ac0d-e4f31750a702 service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.1241786
May 28 14:32:34.026493 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-df620efb-ba4f-4d6f-85b5-7bdb8c7ebeb0 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59 HTTP/1.1" status: 200  len: 1001 time: 0.1017172
May 28 14:32:34.091581 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-120ff908-23e7-440e-a6ea-a4d963e9d9e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:32:34.093108 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-120ff908-23e7-440e-a6ea-a4d963e9d9e0 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.0602410
May 28 14:32:34.167945 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-da7ca26c-1d1b-4a40-b395-256f410083c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:32:34.169971 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-da7ca26c-1d1b-4a40-b395-256f410083c1 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0690129
May 28 14:32:34.302311 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-f8c7d598-7f5d-438f-9c55-98fe2f068e28 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1251400
May 28 14:32:34.436003 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76b27bb1-7611-4003-a726-b3c25875a0ac req-7c8886a8-e290-408b-9bcc-8b4db36d5a1a service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1273003
May 28 14:32:35.367258 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:57.954228 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:32:58.787640 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416a2067-4755-48e1-8b2d-51cc568d038a req-1b370e2f-8293-462a-b37e-cf55a42c3673 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:32:58.789096 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-416a2067-4755-48e1-8b2d-51cc568d038a req-1b370e2f-8293-462a-b37e-cf55a42c3673 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0796955
May 28 14:32:58.837374 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-416a2067-4755-48e1-8b2d-51cc568d038a req-aea4e7f9-f2f7-4b22-9c69-609e75afc052 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0425591
May 28 14:33:00.022897 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a9416129-4290-4d0c-8849-6eee44a849cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:00.027378 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad73606-1d02-4b3b-ae9e-5781222f58ae req-b9764fe9-447a-4815-b4d3-3bb453929df0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:00.028869 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6ad73606-1d02-4b3b-ae9e-5781222f58ae req-b9764fe9-447a-4815-b4d3-3bb453929df0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0800304
May 28 14:33:00.077111 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6ad73606-1d02-4b3b-ae9e-5781222f58ae req-c899c6ed-cb3f-4872-b0b2-65f7f11e3f9a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0423815
May 28 14:33:01.265223 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9fb0776-68e3-45ca-9043-2809233014b2 req-a8366412-f505-470e-adf1-9afa49428313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:01.266730 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f9fb0776-68e3-45ca-9043-2809233014b2 req-a8366412-f505-470e-adf1-9afa49428313 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0812931
May 28 14:33:01.310163 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f9fb0776-68e3-45ca-9043-2809233014b2 req-413e4590-453f-45ed-bd1f-9936d419a6ed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0379324
May 28 14:33:02.497362 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd962751-5552-404c-b3c4-fa3c64538bc6 req-bec11b0b-ba4b-430d-95f9-2a6d7d331efd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:02.498829 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dd962751-5552-404c-b3c4-fa3c64538bc6 req-bec11b0b-ba4b-430d-95f9-2a6d7d331efd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0791383
May 28 14:33:02.543690 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dd962751-5552-404c-b3c4-fa3c64538bc6 req-b33b5b2d-7748-4139-a1e1-2d252aa3a6fd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0388212
May 28 14:33:02.592442 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:02.605806 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3bd72df5-e8ef-431c-a10d-7baea3ae1c96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:03.533194 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:33:03.731735 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:03.743379 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a67055c-dfdd-4352-8201-bd26eb66f496 req-b733bfef-1d79-4681-a708-642fd264c079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:03.745048 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7a67055c-dfdd-4352-8201-bd26eb66f496 req-b733bfef-1d79-4681-a708-642fd264c079 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0834131
May 28 14:33:03.789991 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7a67055c-dfdd-4352-8201-bd26eb66f496 req-a0224b5d-820b-45bf-b6a6-4008c5df62e6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0383470
May 28 14:33:05.074270 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 req-ab6e7182-6549-4eb2-937e-2762b8fb9600 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:05.075670 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 req-ab6e7182-6549-4eb2-937e-2762b8fb9600 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.1755943
May 28 14:33:05.119162 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4b475af8-fd70-4bb7-acd9-4cfb78ab58c3 req-2ab59a0d-c4a0-4ebd-8c25-be539f5f1563 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0378122
May 28 14:33:05.348155 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:06.313184 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-637dc818-4736-48d8-8a8e-49c06fa98969 req-048eb140-fdf0-456a-946d-28e8a30dfd1b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:06.314615 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-637dc818-4736-48d8-8a8e-49c06fa98969 req-048eb140-fdf0-456a-946d-28e8a30dfd1b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0783734
May 28 14:33:06.358811 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-637dc818-4736-48d8-8a8e-49c06fa98969 req-1b09ed5a-b909-486e-9b0a-a9863a54b767 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0385044
May 28 14:33:07.544841 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 req-5e4e0a75-ae2d-4908-8229-0d34b0bf33fa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:07.546299 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 req-5e4e0a75-ae2d-4908-8229-0d34b0bf33fa tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0800409
May 28 14:33:07.593589 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6dc4cbbf-c539-4f8c-b312-4eed43739bb4 req-6456268d-5fdd-43a4-8a85-e37d0038db67 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0417237
May 28 14:33:08.790503 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd7beaca-f735-4cf8-b138-14911bb6b7dd req-efa56eb1-3759-4562-b1a4-ad2a1a1d3e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:08.792419 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cd7beaca-f735-4cf8-b138-14911bb6b7dd req-efa56eb1-3759-4562-b1a4-ad2a1a1d3e47 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0875478
May 28 14:33:08.841492 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cd7beaca-f735-4cf8-b138-14911bb6b7dd req-d9dbdb56-92a4-4741-8791-d216a6f25fc2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0416570
May 28 14:33:10.028364 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 req-4170a1f6-d9f4-4cd2-8460-e3f6b86dbe87 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:10.029800 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 req-4170a1f6-d9f4-4cd2-8460-e3f6b86dbe87 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0785744
May 28 14:33:10.072618 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4915bd9c-a89c-431d-ae8e-41aecc07cf68 req-2bec121e-5faa-4864-8722-60d84a0f3e38 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0372360
May 28 14:33:11.262009 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff1eb21-20cc-48ef-b5ff-968778b873ff req-d5195c56-b227-4491-ab03-7b87f53f9e67 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:11.263453 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5ff1eb21-20cc-48ef-b5ff-968778b873ff req-d5195c56-b227-4491-ab03-7b87f53f9e67 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0789952
May 28 14:33:11.311244 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5ff1eb21-20cc-48ef-b5ff-968778b873ff req-3db9108a-a384-4135-9d48-aae775e20899 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0419760
May 28 14:33:12.502886 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 req-75e34c93-edae-43e8-ac4c-733cd49a23c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:12.504400 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 req-75e34c93-edae-43e8-ac4c-733cd49a23c8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0840795
May 28 14:33:12.549278 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b45ab9a4-2dbf-4df5-a99b-2dbe2d023da0 req-0bd66eb1-94e9-4a22-b048-a8adfc7e41b8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0392549
May 28 14:33:13.736706 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 req-3ff828a3-1711-499d-8f2c-e1bcbb14b283 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:13.738152 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 req-3ff828a3-1711-499d-8f2c-e1bcbb14b283 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0798531
May 28 14:33:13.782839 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3bc13e8a-8d77-408b-81a5-9ccb43b3e193 req-5679e574-21c4-4d44-882d-a11c56e72b85 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0388751
May 28 14:33:14.973186 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27f9dd2-3d9c-4b90-accb-9c3033344277 req-4f4b96ec-48df-4792-b530-7b3083c65366 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:14.974651 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c27f9dd2-3d9c-4b90-accb-9c3033344277 req-4f4b96ec-48df-4792-b530-7b3083c65366 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0805395
May 28 14:33:15.019645 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c27f9dd2-3d9c-4b90-accb-9c3033344277 req-eb0ab699-3756-4af3-a706-82cce5c2edf7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0391679
May 28 14:33:15.712245 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 65e6ef94-43dd-499b-b9bb-2e42a8536b59 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:33:15.879041 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:33:15.892278 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'port_id': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'mac_address': 'fa:16:3e:ca:52:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 869, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:33:15.945906 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:15.963110 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 65e6ef94-43dd-499b-b9bb-2e42a8536b59 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:33:15.978241 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:33:16.102090 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:16.105598 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b1a865fe-6c27-43b7-9880-bcd4ceefd2fc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:33:16.181866 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=6']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:33:16.190507 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.190851 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.191190 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.191524 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.191942 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.192208 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.192533 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.192855 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.193179 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.193504 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.193816 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.194130 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:33:16.198245 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:33:16.202696 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['65e6ef94-43dd-499b-b9bb-2e42a8536b59'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:33:16.212588 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af360292-7cc6-46c1-ab0f-35961d49ada7 req-51e477d0-92eb-4450-83e0-5e951f2e4f7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:16.214304 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-af360292-7cc6-46c1-ab0f-35961d49ada7 req-51e477d0-92eb-4450-83e0-5e951f2e4f7a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 944 time: 0.0856876
May 28 14:33:16.259611 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-af360292-7cc6-46c1-ab0f-35961d49ada7 req-572fcb56-5301-4d13-98c1-c4895bcc84d0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0395081
May 28 14:33:17.450715 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0602c5b-676b-4d3c-870e-7718f9e476e9 req-9e0c6242-3fe6-480d-9e9f-f27a6181098e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:17.452114 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a0602c5b-676b-4d3c-870e-7718f9e476e9 req-9e0c6242-3fe6-480d-9e9f-f27a6181098e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 944 time: 0.0840173
May 28 14:33:17.496073 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a0602c5b-676b-4d3c-870e-7718f9e476e9 req-95759a1a-cd7e-46c1-a59a-cd5b1a11c3f9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0381057
May 28 14:33:17.755061 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 65e6ef94-43dd-499b-b9bb-2e42a8536b59 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:33:17.824597 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:33:17.825279 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:17.939607 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:17.966370 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:33:17.977184 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:33:18.185980 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:18.187948 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:33:18.217881 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'code': 200}
May 28 14:33:18.254512 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=7']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:33:18.257478 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:33:18.684255 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288068ab-5849-496a-8f0b-e6ac3675d096 req-43607b15-4d05-4c03-bd57-1d1dd8dff6b6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:18.685683 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-288068ab-5849-496a-8f0b-e6ac3675d096 req-43607b15-4d05-4c03-bd57-1d1dd8dff6b6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0791683
May 28 14:33:18.732028 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-288068ab-5849-496a-8f0b-e6ac3675d096 req-b4e8aa17-1430-4f97-be57-520fdf964b2d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0408080
May 28 14:33:19.926625 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c54f337a-af8c-4c94-8aec-2a297f437d26 req-3702f4c9-bfa2-4bd3-987a-1ed6896e9adc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:19.928082 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c54f337a-af8c-4c94-8aec-2a297f437d26 req-3702f4c9-bfa2-4bd3-987a-1ed6896e9adc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0804272
May 28 14:33:19.972469 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c54f337a-af8c-4c94-8aec-2a297f437d26 req-6bfe6f06-59b7-4994-98e0-3973b76d0e62 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0387969
May 28 14:33:21.160631 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158d8adb-5d6b-4f4b-8405-199b2d1de383 req-f171c303-cf05-4240-bf47-38bf9a822c94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:21.162175 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-158d8adb-5d6b-4f4b-8405-199b2d1de383 req-f171c303-cf05-4240-bf47-38bf9a822c94 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0801697
May 28 14:33:21.205884 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-158d8adb-5d6b-4f4b-8405-199b2d1de383 req-adc24035-eea3-407e-b9b5-a6f80032d70e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0380135
May 28 14:33:22.485003 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca8f31e-0ce1-492a-ab91-946acb93040d req-87cd29d6-bfa5-42c4-b68d-12d3c4cf934d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:22.486472 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8ca8f31e-0ce1-492a-ab91-946acb93040d req-87cd29d6-bfa5-42c4-b68d-12d3c4cf934d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.1709778
May 28 14:33:22.534173 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8ca8f31e-0ce1-492a-ab91-946acb93040d req-49f53cd1-ce17-4e1b-9277-49177093a156 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0417717
May 28 14:33:23.728350 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69d8a6f-204e-40fe-88e1-8c299741a670 req-f21d4fb7-e5eb-4fdc-b890-f86ac1ff0030 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:23.730362 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c69d8a6f-204e-40fe-88e1-8c299741a670 req-f21d4fb7-e5eb-4fdc-b890-f86ac1ff0030 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0843811
May 28 14:33:23.778788 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c69d8a6f-204e-40fe-88e1-8c299741a670 req-019faff3-2621-4dcc-97e5-e0404db62531 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0427001
May 28 14:33:24.979428 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943ed18b-1701-4bd1-b43f-ce4e590b3408 req-3a4a3e61-3f27-4d35-a102-84940779a603 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:24.980922 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-943ed18b-1701-4bd1-b43f-ce4e590b3408 req-3a4a3e61-3f27-4d35-a102-84940779a603 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0876253
May 28 14:33:25.033902 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-943ed18b-1701-4bd1-b43f-ce4e590b3408 req-b79888dc-da59-426d-81dc-d8a57de70de8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0471838
May 28 14:33:26.242127 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc36d53-894f-4542-84c3-76853c8a5f81 req-58d4a478-1a2c-4d3f-8703-9147ad6b5fbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:26.243598 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dbc36d53-894f-4542-84c3-76853c8a5f81 req-58d4a478-1a2c-4d3f-8703-9147ad6b5fbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0903711
May 28 14:33:26.293267 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dbc36d53-894f-4542-84c3-76853c8a5f81 req-33cfa085-57b8-49d8-9cf9-1b5a759b17a3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0432482
May 28 14:33:27.495635 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca req-9723a3bc-b50e-4590-918a-b18ab30b845b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:27.497443 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca req-9723a3bc-b50e-4590-918a-b18ab30b845b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0868838
May 28 14:33:27.553504 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfc71eac-866a-46a7-a78f-3cb4505cc7ca req-3a804008-2a9c-4c70-8b52-1b225a7effab tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0494797
May 28 14:33:27.953321 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:28.760649 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b35392e6-59c6-4c43-86ad-304c0925775d req-73dc1a49-c8d4-41e7-81e5-72f4ab6f3616 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:28.762226 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b35392e6-59c6-4c43-86ad-304c0925775d req-73dc1a49-c8d4-41e7-81e5-72f4ab6f3616 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0936029
May 28 14:33:28.827072 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b35392e6-59c6-4c43-86ad-304c0925775d req-00c47411-e177-4cb9-a760-99506a8c75b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0550508
May 28 14:33:30.020923 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 req-4dce7294-3dc6-4ab9-9fe9-e2de023429fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:30.022408 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 req-4dce7294-3dc6-4ab9-9fe9-e2de023429fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0968523
May 28 14:33:30.060895 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b8e8cbf8-372a-4345-8b19-78f223070d30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:30.077139 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1c6b87a3-8bdd-4e77-a14c-d756af1768f5 req-e6b35a35-0697-4316-b8e8-d46f9f053491 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0485032
May 28 14:33:31.292976 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc163216-6c76-44e0-9312-5123eb9b787e req-f7eaabdd-1e6b-4134-86d1-18ec20d94de0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:31.294484 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc163216-6c76-44e0-9312-5123eb9b787e req-f7eaabdd-1e6b-4134-86d1-18ec20d94de0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0840206
May 28 14:33:31.341985 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bc163216-6c76-44e0-9312-5123eb9b787e req-d3e7887e-810b-4f2e-928b-4d2e0cfa8135 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0413349
May 28 14:33:32.535812 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1381d569-4693-497d-8bdc-697a47ab903b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:32.550780 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bafb91fe-6588-4ddc-b994-6a7dc75966bd req-f2797aad-ba35-4f9d-85c3-399524632a0a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:32.552365 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bafb91fe-6588-4ddc-b994-6a7dc75966bd req-f2797aad-ba35-4f9d-85c3-399524632a0a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0885499
May 28 14:33:32.600674 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bafb91fe-6588-4ddc-b994-6a7dc75966bd req-28c08886-6568-4467-9b6a-78d9ef6f6d12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0423591
May 28 14:33:32.604901 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:33.745935 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:33.823394 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 req-15720068-df4f-4370-a0ae-47244a563b43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:33.825622 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 req-15720068-df4f-4370-a0ae-47244a563b43 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.1012979
May 28 14:33:33.873022 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4861f3f2-d8cd-4263-a20c-c4bd1e681a50 req-2bcf1cb8-cd8a-4136-a324-9e60ea1a8fbd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0415411
May 28 14:33:35.078813 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e req-544d4c70-0d40-4529-9c12-f9b53f9d40e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:35.080215 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e req-544d4c70-0d40-4529-9c12-f9b53f9d40e5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0878096
May 28 14:33:35.124884 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4aad4f3a-1a5c-4b88-a51f-e0ee332a185e req-9c37f648-b798-4068-a75f-a2c9bcb45029 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0390627
May 28 14:33:35.353115 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:35.667946 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-05a6b66c-99bf-4224-b541-a46db58161df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:35.669319 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-05a6b66c-99bf-4224-b541-a46db58161df service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 1098 time: 0.0711386
May 28 14:33:35.802808 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-2bbfcc60-07f1-42a2-80d1-45537d9a8dfa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:35.804277 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-2bbfcc60-07f1-42a2-80d1-45537d9a8dfa service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.1283987
May 28 14:33:35.907223 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-5ce2789c-54d0-4053-9138-4c55e4e4b586 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59 HTTP/1.1" status: 200  len: 1001 time: 0.0964611
May 28 14:33:35.972139 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-ac106d3d-de89-4f52-95d8-e3406c115668 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:35.973581 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-ac106d3d-de89-4f52-95d8-e3406c115668 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.0597978
May 28 14:33:36.047519 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-2a42f277-5b52-4b4d-b518-c41c6b11ab8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:36.048958 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-2a42f277-5b52-4b4d-b518-c41c6b11ab8e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0681236
May 28 14:33:36.190547 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-487e1bdb-9ae1-4cfa-ba95-dd314d3d4973 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1347954
May 28 14:33:36.315003 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c870ff6-329d-4c39-983c-4618e0bf3e7b req-86efd2ac-9915-4f1c-8e54-ae3781681a84 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:36.316384 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1c870ff6-329d-4c39-983c-4618e0bf3e7b req-86efd2ac-9915-4f1c-8e54-ae3781681a84 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0801182
May 28 14:33:36.324567 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfafcb98-faca-4088-af1e-122f9ae7a713 req-1870bda8-b411-450b-bdb9-e544497caf1b service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1264842
May 28 14:33:36.365421 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1c870ff6-329d-4c39-983c-4618e0bf3e7b req-83aea6fc-9c9f-4ef8-ac7c-4e314f7000ed tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0429399
May 28 14:33:36.569530 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-9384ba2c-d9a6-47a8-a1df-9a1c46e144fc service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0684130
May 28 14:33:36.664101 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-37477b27-9d71-4922-89ea-6f0d4d038864 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:36.665574 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-37477b27-9d71-4922-89ea-6f0d4d038864 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 1098 time: 0.0744257
May 28 14:33:36.812652 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-0a6af93a-aa33-427c-be96-f49bf623850f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:36.814431 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-0a6af93a-aa33-427c-be96-f49bf623850f service neutron] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 913 time: 0.1282146
May 28 14:33:37.011357 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-97b377c9-241c-471d-9d07-c27ec399ef9b service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b HTTP/1.1" status: 200  len: 1000 time: 0.1899641
May 28 14:33:37.074117 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-81eb4a50-47b9-4288-bbf4-20b849e306fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:37.075519 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-81eb4a50-47b9-4288-bbf4-20b849e306fb service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.0576541
May 28 14:33:37.157566 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-a678e19a-72ea-4e88-a454-947133afa3d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:37.159032 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-a678e19a-72ea-4e88-a454-947133afa3d5 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0748391
May 28 14:33:37.299422 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-f16f71be-0ef1-45f4-a0d9-c92cb00ad5fa service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1309762
May 28 14:33:37.433756 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7ff356a2-06f8-471a-899a-5ffc98d8e27a req-9af844ed-a707-4074-9e0a-1345dea7b6c0 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1255076
May 28 14:33:37.553659 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a139b3b-c039-4ac1-809e-5e0019e44c9d req-c1efb5ed-55a9-44b4-976c-94df24cef068 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:37.555007 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a139b3b-c039-4ac1-809e-5e0019e44c9d req-c1efb5ed-55a9-44b4-976c-94df24cef068 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0797548
May 28 14:33:37.598391 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a139b3b-c039-4ac1-809e-5e0019e44c9d req-e10a9dec-c3f2-4a53-9c32-d8cff9906a5c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0377002
May 28 14:33:38.787182 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711b7ce0-f870-4620-8626-dfbcdc807a40 req-626ea38f-0f51-4db5-94c5-0635fcaaadfd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:38.788677 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-711b7ce0-f870-4620-8626-dfbcdc807a40 req-626ea38f-0f51-4db5-94c5-0635fcaaadfd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 945 time: 0.0820918
May 28 14:33:38.834583 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-711b7ce0-f870-4620-8626-dfbcdc807a40 req-1bc0c778-712b-4f63-8fbc-76512afe8180 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0395088
May 28 14:33:39.896603 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 65e6ef94-43dd-499b-b9bb-2e42a8536b59 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:33:40.008471 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:40.034216 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:33:40.044980 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:33:40.078022 dv-cinder-791281-3-iscsi neutron-server[92696]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'code': 422} returned with failed status
May 28 14:33:40.147249 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:40.149089 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:33:40.218283 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=8']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:33:40.221500 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:33:40.531433 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:33:41.643424 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-845c9f60-9533-40e0-babd-30f7eca8c891 req-a91e00d4-2b5a-4c52-aa4d-4bcadd4e3466 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:41.645079 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-845c9f60-9533-40e0-babd-30f7eca8c891 req-a91e00d4-2b5a-4c52-aa4d-4bcadd4e3466 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0858774
May 28 14:33:41.690355 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-845c9f60-9533-40e0-babd-30f7eca8c891 req-89ab31f7-466a-4d62-a90e-fb44bf74098d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0395074
May 28 14:33:42.145391 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 39958) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:33:42.257885 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-1839b0a8-c8ec-4bd8-a78b-0065e34445cd service neutron] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1111867
May 28 14:33:42.880533 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-552eae83-5d28-407d-9089-86216ec60e6e req-97c1dcc6-3fb3-449f-8356-2313e0e8e01e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:42.881970 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-552eae83-5d28-407d-9089-86216ec60e6e req-97c1dcc6-3fb3-449f-8356-2313e0e8e01e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0841663
May 28 14:33:42.925677 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-552eae83-5d28-407d-9089-86216ec60e6e req-cc1a45d1-e834-4de7-8ed4-dea401a40032 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0379214
May 28 14:33:44.114442 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce req-034a2040-e3b5-4370-ab6b-0e69ef8060cc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:44.115932 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce req-034a2040-e3b5-4370-ab6b-0e69ef8060cc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0842900
May 28 14:33:44.160538 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bb9963d5-c6eb-4c6d-8f7d-3ffecbcae4ce req-c96f4f3e-6474-420a-9d63-4303338f91f4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0382648
May 28 14:33:45.358131 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f req-f9b7a35b-1608-4607-9684-f3587c1ee80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:45.359572 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f req-f9b7a35b-1608-4607-9684-f3587c1ee80f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0885441
May 28 14:33:45.412329 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d8082d6c-f19e-4bc4-9778-b136f04b3d6f req-8d0e007c-318d-4e03-a922-575d23de171f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0464065
May 28 14:33:45.975664 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-5b80e872-c89d-4881-8815-3e7ef707a971 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:45.977114 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-5b80e872-c89d-4881-8815-3e7ef707a971 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464&tenant_id=3bbdb80ac64d4db395d276876322e7b0 HTTP/1.1" status: 200  len: 1096 time: 0.0786417
May 28 14:33:46.072298 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-5367c0f3-fff5-427b-a27c-1f0cad42a2fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:46.073684 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-5367c0f3-fff5-427b-a27c-1f0cad42a2fb service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=3bbdb80ac64d4db395d276876322e7b0&device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 1096 time: 0.0730207
May 28 14:33:46.208012 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-920fbde2-d6e1-4281-81b3-fe48f15e3227 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:46.209461 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-920fbde2-d6e1-4281-81b3-fe48f15e3227 service neutron] 10.222.0.90 "GET /v2.0/networks?id=936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 200  len: 918 time: 0.1291068
May 28 14:33:46.313729 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-59d7f482-16f3-491d-9e55-0b913d7c7eaf service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59 HTTP/1.1" status: 200  len: 999 time: 0.0974824
May 28 14:33:46.376484 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-7409f25f-1bcf-44ef-ae2d-ac05732a6d51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:46.377836 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-7409f25f-1bcf-44ef-ae2d-ac05732a6d51 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 200  len: 856 time: 0.0573504
May 28 14:33:46.458358 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-c7393c70-d75a-4823-92c7-a6e5d70b9a7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:46.460080 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-c7393c70-d75a-4823-92c7-a6e5d70b9a7e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=936c4847-d3d4-4250-b543-dc72dd308858&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0753179
May 28 14:33:46.595157 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-347d9a19-58aa-4bda-8ea8-d9215647e799 service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1286085
May 28 14:33:46.614978 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae7162d3-b147-4781-b022-8fc12f04fdb0 req-b824e117-62ad-48e1-9d04-48624c57dbd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:46.616474 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ae7162d3-b147-4781-b022-8fc12f04fdb0 req-b824e117-62ad-48e1-9d04-48624c57dbd8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0807204
May 28 14:33:46.662681 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ae7162d3-b147-4781-b022-8fc12f04fdb0 req-8cebc1df-afe3-4b49-86e4-803d602c3901 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0398350
May 28 14:33:46.729584 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-3b9e1075-0ccd-4bc3-9cdb-fd119cdf0d3b service neutron] 10.222.0.90 "GET /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1282668
May 28 14:33:47.858555 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0970ba3-6322-4eea-a3dd-98e533e03456 req-31997a34-309a-448d-b1bc-d014aa7efad6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:47.860023 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f0970ba3-6322-4eea-a3dd-98e533e03456 req-31997a34-309a-448d-b1bc-d014aa7efad6 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0816503
May 28 14:33:47.907721 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f0970ba3-6322-4eea-a3dd-98e533e03456 req-c48d1524-6850-4f0a-8563-7d69c8b8f6ee tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0412090
May 28 14:33:49.195903 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52f9a26-6305-49fb-aec9-73843faff165 req-2215885b-40fb-4a93-8afb-e01ee70ce0bf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:49.197377 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b52f9a26-6305-49fb-aec9-73843faff165 req-2215885b-40fb-4a93-8afb-e01ee70ce0bf tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.1753521
May 28 14:33:49.245944 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b52f9a26-6305-49fb-aec9-73843faff165 req-1fdfa635-410b-42f2-872b-fd416b47b206 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0414381
May 28 14:33:50.548299 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00029bbc-0300-4d42-8f34-a6a52ba041fe req-720379c3-1ee6-46d9-8494-65ab0f9640b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:50.549774 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-00029bbc-0300-4d42-8f34-a6a52ba041fe req-720379c3-1ee6-46d9-8494-65ab0f9640b1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.1868663
May 28 14:33:50.597617 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-00029bbc-0300-4d42-8f34-a6a52ba041fe req-e508fc70-51ea-453f-9d92-699db0bccf21 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0419931
May 28 14:33:51.816577 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8867fe2c-7660-418f-8c55-f36df1e1038e req-704d8103-015b-42a5-83b2-aee7538771a3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:51.824499 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8867fe2c-7660-418f-8c55-f36df1e1038e req-704d8103-015b-42a5-83b2-aee7538771a3 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0923150
May 28 14:33:51.875291 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8867fe2c-7660-418f-8c55-f36df1e1038e req-f0cd9a16-f95e-4ac2-9f4c-1471050180ce tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0514691
May 28 14:33:53.076613 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16824e7-b9a5-4df6-82a4-2673009031af req-238eb754-96aa-4944-affb-54750ef292a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:53.078006 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c16824e7-b9a5-4df6-82a4-2673009031af req-238eb754-96aa-4944-affb-54750ef292a7 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0878077
May 28 14:33:53.125188 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c16824e7-b9a5-4df6-82a4-2673009031af req-3cea57f2-d832-4076-83db-d343a0dcb7b9 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0415204
May 28 14:33:54.314337 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86980117-8b39-4525-b901-a8a0e4001c04 req-0378ab11-293a-4253-9195-0a02c76b35a4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:54.315794 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-86980117-8b39-4525-b901-a8a0e4001c04 req-0378ab11-293a-4253-9195-0a02c76b35a4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0796187
May 28 14:33:54.359429 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-86980117-8b39-4525-b901-a8a0e4001c04 req-088de576-f01d-4d7d-bcbb-6b756e8e77f0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0379610
May 28 14:33:55.551507 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 req-034f6bf8-78f8-4fa7-8581-e05b11e16a74 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:55.552976 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 req-034f6bf8-78f8-4fa7-8581-e05b11e16a74 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0789678
May 28 14:33:55.598586 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-69c9251d-7d38-4504-aeb1-32d1ba0f7800 req-ff577d0d-15d7-41a1-8f76-6a4d4b0fe27b tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0391748
May 28 14:33:56.793811 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508aa076-3000-4481-b3d8-b4ff4b9c2198 req-00824c14-513a-4f91-8dc9-fe485fed945f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:56.795234 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-508aa076-3000-4481-b3d8-b4ff4b9c2198 req-00824c14-513a-4f91-8dc9-fe485fed945f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0830102
May 28 14:33:56.841114 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-508aa076-3000-4481-b3d8-b4ff4b9c2198 req-9928dba0-b92e-472e-9c5f-835aaf8728ac tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0402360
May 28 14:33:57.952255 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:33:58.040543 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff req-9101c925-f219-4a7a-adce-3c5c97f195ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:58.046710 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff req-9101c925-f219-4a7a-adce-3c5c97f195ad tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0925608
May 28 14:33:58.092353 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1eb6062a-6bf4-4fcf-b3e0-8062b8f055ff req-da623f63-71bc-4d59-a467-b2703686e540 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0396793
May 28 14:33:59.281713 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 req-bb2d8908-1347-4256-baf1-c54df18141fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:33:59.283145 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 req-bb2d8908-1347-4256-baf1-c54df18141fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0789917
May 28 14:33:59.328236 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-eef095a4-ee90-4bd8-b4ca-f994318f58a1 req-f030357f-8f73-4ba6-a6f0-0a5e2fea530c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0394781
May 28 14:34:00.009029 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-77eb8536-8113-494a-bf4b-ce40b4ef233d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:00.574195 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2066dfcc-d1c6-426d-9373-070b7b474f9f req-d3ce55b6-32f8-4750-9d36-d81fe9807337 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:00.576943 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2066dfcc-d1c6-426d-9373-070b7b474f9f req-d3ce55b6-32f8-4750-9d36-d81fe9807337 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0810611
May 28 14:34:00.628065 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2066dfcc-d1c6-426d-9373-070b7b474f9f req-e9238ce4-60c3-4b1c-aad5-66208afb4e96 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0462143
May 28 14:34:01.831828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a req-8d895b3f-5a3b-4b59-8cac-f280a6bd8077 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:01.833298 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a req-8d895b3f-5a3b-4b59-8cac-f280a6bd8077 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0857368
May 28 14:34:01.878774 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1437dcd8-57a2-46e7-b971-c56d55d2ef4a req-09500a4a-9829-4e54-8801-9da07cb31879 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0393522
May 28 14:34:02.527195 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:02.539897 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f21ba495-3696-4cac-9478-cdea846dd0f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:03.074484 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fbf788f-fde3-4304-95f8-87da37bbce98 req-7e072e11-fa9b-4299-abc0-ace1bd3e0d58 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:03.076384 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fbf788f-fde3-4304-95f8-87da37bbce98 req-7e072e11-fa9b-4299-abc0-ace1bd3e0d58 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0838094
May 28 14:34:03.120028 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3fbf788f-fde3-4304-95f8-87da37bbce98 req-bec2bfce-19ec-45ee-9d94-b28ffb201228 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0375407
May 28 14:34:03.927145 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:04.309301 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 req-b36996fb-a3c5-42a0-a194-38e2a937c706 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:04.310782 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 req-b36996fb-a3c5-42a0-a194-38e2a937c706 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0804443
May 28 14:34:04.359716 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a2947754-6d30-4c49-b1e2-323e51d3e8a6 req-6ad6fc33-0469-4969-95d4-ee4113e2011a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0431731
May 28 14:34:05.389841 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:05.550458 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-217573f7-4359-4798-a61a-bee70ade7ec6 req-25b786f3-72aa-4637-85a4-934b81908cbc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:05.551963 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-217573f7-4359-4798-a61a-bee70ade7ec6 req-25b786f3-72aa-4637-85a4-934b81908cbc tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 943 time: 0.0803554
May 28 14:34:05.602113 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-217573f7-4359-4798-a61a-bee70ade7ec6 req-90784d7d-cc18-46eb-b3b9-2c0b520ea913 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0436254
May 28 14:34:06.104786 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 65e6ef94-43dd-499b-b9bb-2e42a8536b59 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:34:06.235357 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:06.248181 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'port_id': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'mac_address': 'fa:16:3e:ca:52:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 869, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:34:06.304166 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:06.320037 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 65e6ef94-43dd-499b-b9bb-2e42a8536b59 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:34:06.335168 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:06.408376 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:06.410056 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:06.477865 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=9']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:06.481940 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:06.794861 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e653e37-86d4-4a1b-af88-80496a477e32 req-f003e859-f1c3-4ac1-acdb-4d75627db05c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:06.796418 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9e653e37-86d4-4a1b-af88-80496a477e32 req-f003e859-f1c3-4ac1-acdb-4d75627db05c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 944 time: 0.0833824
May 28 14:34:06.842166 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9e653e37-86d4-4a1b-af88-80496a477e32 req-504a2c9a-d372-43a9-88a7-c18a85279764 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0400431
May 28 14:34:07.152513 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['65e6ef94-43dd-499b-b9bb-2e42a8536b59'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:34:08.031924 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 req-7f363372-732b-4cd9-8b58-dc515bcd2f19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:08.033408 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 req-7f363372-732b-4cd9-8b58-dc515bcd2f19 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 944 time: 0.0812275
May 28 14:34:08.049147 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-2e5857d1-79d4-423b-bfc4-69294d247c65 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2127224596&fields=id&tenant_id=c6d2d25991f04f00a48394ddbeec688e HTTP/1.1" status: 200  len: 267 time: 0.0392120
May 28 14:34:08.077778 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fff1ef70-e7dc-497e-9ec6-f8e7ef9b8943 req-59fd915b-a715-4e80-82c5-b09ed24ecdb5 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0387280
May 28 14:34:08.120698 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 65e6ef94-43dd-499b-b9bb-2e42a8536b59 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:34:08.188086 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:34:08.188462 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:08.201778 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-47dc0807-1133-4c87-a071-e870eaebc76e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:08.203208 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-47dc0807-1133-4c87-a071-e870eaebc76e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 812 time: 0.1473570
May 28 14:34:08.218393 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-7a6e991d-470f-48c1-bc74-ef3dc20fce0f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/quotas/c6d2d25991f04f00a48394ddbeec688e HTTP/1.1" status: 200  len: 375 time: 0.0095959
May 28 14:34:08.307795 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:08.310488 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-36332aae-3a27-4242-8b84-69ad7c59f42e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0868871
May 28 14:34:08.336288 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:34:08.346570 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:08.385752 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'code': 200}
May 28 14:34:08.431419 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:08.433313 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-175710a2-e19d-4c39-a10a-a9163028f412 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:08.498317 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-198a2311-298a-48fb-af27-9c978b4a2e42 service neutron] 10.222.0.59 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1766222
May 28 14:34:08.501537 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=10']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:08.504541 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:08.633342 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-619dfbe3-a8df-48bd-b95d-792f64896a19 service neutron] 10.222.0.59 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1285448
May 28 14:34:08.737951 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5c7934-a846-4838-afe8-2fb48667d95d req-daed6071-c4db-4d09-8ff7-55fb9d493f18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:08.739443 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bc5c7934-a846-4838-afe8-2fb48667d95d req-daed6071-c4db-4d09-8ff7-55fb9d493f18 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 1099 time: 0.0739486
May 28 14:34:08.781579 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bc5c7934-a846-4838-afe8-2fb48667d95d req-c3f6ae81-396c-4e45-9625-d6648ad7926d service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0352986
May 28 14:34:09.266893 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da0e8459-54b3-4ada-97be-a21b32a66c04 req-63769195-5564-4858-83c6-ddada1d54b33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:09.268371 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-da0e8459-54b3-4ada-97be-a21b32a66c04 req-63769195-5564-4858-83c6-ddada1d54b33 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 946 time: 0.0787568
May 28 14:34:09.318926 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-da0e8459-54b3-4ada-97be-a21b32a66c04 req-0bbcd49e-d4de-4fdd-80ca-89e5adab17e8 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0436678
May 28 14:34:09.362254 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7960a94a-a7e5-4b5c-adb9-d09c72cbe36f req-fe5e101d-77b6-4bb7-85b9-b640cb8975d7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 210 time: 0.0432475
May 28 14:34:10.519586 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6df0f340-0b35-4a5f-b83b-5f27f38d3612 req-9078be25-ea14-43fe-8f5b-4a93edba80cd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 210 time: 0.0483875
May 28 14:34:10.526940 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c16d193-7325-4d9f-9563-eac33ef8623b req-5b3e4220-5ce6-4c30-809c-8e724faec9fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:10.528531 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8c16d193-7325-4d9f-9563-eac33ef8623b req-5b3e4220-5ce6-4c30-809c-8e724faec9fb tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 946 time: 0.0977507
May 28 14:34:10.574556 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8c16d193-7325-4d9f-9563-eac33ef8623b req-e09a1aa5-c572-4f2e-851e-eb3874f90d21 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0399106
May 28 14:34:11.491970 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8bafe6f5-2d33-4dbb-bcce-159b2ac24d29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:11.493437 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8bafe6f5-2d33-4dbb-bcce-159b2ac24d29 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 812 time: 0.1496375
May 28 14:34:11.542413 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-cd580692-5b38-415e-abc9-a0a9cbe6ef22 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c6d2d25991f04f00a48394ddbeec688e HTTP/1.1" status: 200  len: 380 time: 0.0398557
May 28 14:34:11.551179 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'port': {'device_id': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'admin_state_up': True, 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'security_groups': ['fe9fa133-b1e0-4e56-971e-af9cdb27b031']}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:34:11.703471 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-60ce6281-77f7-48cf-a3e4-79373fe6d478 req-1bf26aa7-b97e-44b2-873c-4d3a43b4b4ab tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 210 time: 0.0571282
May 28 14:34:11.707667 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:34:11.718490 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:34:11.803615 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Made reservation on behalf of c6d2d25991f04f00a48394ddbeec688e for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:34:11.807281 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:11.907144 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3f616e-d769-4240-a930-caf71c9a60d0 req-bec148c2-c995-43ce-8874-16fd8b7ac6bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:11.908626 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1c3f616e-d769-4240-a930-caf71c9a60d0 req-bec148c2-c995-43ce-8874-16fd8b7ac6bd tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 946 time: 0.1639204
May 28 14:34:12.008646 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1c3f616e-d769-4240-a930-caf71c9a60d0 req-470804a7-4722-4da2-ae58-3b9da979da29 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0932257
May 28 14:34:12.027249 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Allocated IP 172.20.0.10 (89b0ce92-0695-466c-b1ce-9a354ecba633/a63662e1-f44d-44cd-98c9-2b87dba66278/0c4d0a98-5c2e-401f-a013-9e7bf90a9c78) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:34:12.315589 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:12.330953 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Transition to ACTIVE for port object 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:34:12.460073 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:12.466366 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-9d3f935c-1780-4a4b-abea-f5c56766a4a0 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:12.535831 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:34:12.539068 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:34:12.542743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:34:12.573857 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'Port': ['ID=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:12.588952 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.589347 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.589699 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.590131 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.590983 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.591341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.591724 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.592080 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.592426 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.592956 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.593306 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.593675 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:12.602869 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:12.624643 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:12.625285 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:12.717887 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1703241
May 28 14:34:12.733073 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Request body: {'port': {'device_id': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:34:12.856366 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:12.899581 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 req-1d00b1b0-a07b-484b-9239-63667446e2f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:12.901045 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 req-1d00b1b0-a07b-484b-9239-63667446e2f1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 932 time: 0.0803258
May 28 14:34:12.905514 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7d93366d-68fd-4371-a071-15db5914d94a None None] Provisioning for port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:34:12.911164 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7d93366d-68fd-4371-a071-15db5914d94a None None] Provisioning complete for port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:34:12.911759 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7d93366d-68fd-4371-a071-15db5914d94a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:12.953134 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-26a1f99e-8019-4b25-91fe-7faedcf8d4e5 req-6bcaffc8-2741-4692-8497-5289a871a8a7 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456781
May 28 14:34:12.999652 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7d93366d-68fd-4371-a071-15db5914d94a None None] Port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:34:13.209269 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:34:13.216664 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:13.231898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Transition to ACTIVE for port object 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:34:13.314699 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:13.319324 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8d268f2f-ac40-4043-87a5-4ba27e1a732b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:13.468839 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Pushing event updated for resources: {'Port': ['ID=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:13.478932 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:13.552122 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Attempting to bind port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:34:13.552754 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Attempting to bind port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:34:13.552754 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Attempting to bind port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 on network 89b0ce92-0695-466c-b1ce-9a354ecba633 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:34:13.557326 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 on network 89b0ce92-0695-466c-b1ce-9a354ecba633 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:34:13.557645 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Attempting to bind port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 on network 89b0ce92-0695-466c-b1ce-9a354ecba633 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:34:13.562743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 33, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:34:13.563075 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Checking segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:34:13.563456 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Bound using segment: {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:34:13.563911 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Bound port: 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2adec342-3afa-48b6-acc6-9f4a9ce2773e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:34:13.564253 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:13.655290 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] For port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:34:13.658277 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] For port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:34:13.779933 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:13.783592 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-00c08cca-7975-4280-beea-484bc38c3372 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:13.842267 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:13.842881 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:13.844250 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] 10.222.0.90 "PUT /v2.0/ports/0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 HTTP/1.1" status: 200  len: 1094 time: 1.1153669
May 28 14:34:13.844758 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:34:13.870577 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Pushing event updated for resources: {'Port': ['ID=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:13.874545 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:13.892504 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'status': 'completed', 'code': 200}
May 28 14:34:13.988496 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-d2917869-f80d-4a91-8c3e-931010a50b3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:13.989909 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-d2917869-f80d-4a91-8c3e-931010a50b3f service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 1097 time: 0.0751548
May 28 14:34:14.132014 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-67639d64-ddce-4f60-b3e1-4f911a7c83db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:14.133536 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-67639d64-ddce-4f60-b3e1-4f911a7c83db service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=c6d2d25991f04f00a48394ddbeec688e&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1364372
May 28 14:34:14.144574 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04c356a2-d6cb-4133-93ad-d2fe78473572 req-9152ef15-2d1a-46e6-b91c-0d2d974a944b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:14.146027 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-04c356a2-d6cb-4133-93ad-d2fe78473572 req-9152ef15-2d1a-46e6-b91c-0d2d974a944b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 944 time: 0.0812688
May 28 14:34:14.192390 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-04c356a2-d6cb-4133-93ad-d2fe78473572 req-be413fba-ec8b-4db4-8982-d36fa8ad2fcf tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406711
May 28 14:34:14.273470 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-e2cd86e5-7ee0-425c-9d86-3174d5bf6141 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:14.275002 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3241670e-1c2e-46c3-ac14-c38203eac624 req-e2cd86e5-7ee0-425c-9d86-3174d5bf6141 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1342447
May 28 14:34:14.387268 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-aa076b60-be6b-4b2f-880b-a8ada5fcbaf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:14.388748 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-aa076b60-be6b-4b2f-880b-a8ada5fcbaf3 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 1097 time: 0.0775728
May 28 14:34:14.459328 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-4315ca08-96bf-4da5-a503-43d5dfbaa4eb service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 HTTP/1.1" status: 200  len: 217 time: 0.0627775
May 28 14:34:14.608043 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-d28676ea-8df3-48f0-8f86-b8377bc28601 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:14.609453 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-d28676ea-8df3-48f0-8f86-b8377bc28601 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.1435225
May 28 14:34:14.688072 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-39ba52c9-e931-49e4-9a5f-84e1e82297a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:14.689480 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-39ba52c9-e931-49e4-9a5f-84e1e82297a6 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0728536
May 28 14:34:14.820730 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-2746a033-9414-46f6-884d-254f4061ed53 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1235309
May 28 14:34:14.950063 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-07c4b5a0-2b20-408f-9fd8-0e2aa9139ea3 req-aadaa055-7bcc-4be3-b6e8-717630a3b085 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1229627
May 28 14:34:15.375644 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c0004dc-e6b7-4efe-8004-a545fc575024 req-8d8b2e6c-ea3d-4b23-b604-a19c44a47e41 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:15.376242 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-4c0004dc-e6b7-4efe-8004-a545fc575024 req-8d8b2e6c-ea3d-4b23-b604-a19c44a47e41 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:34:15.453934 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-4c0004dc-e6b7-4efe-8004-a545fc575024 req-8d8b2e6c-ea3d-4b23-b604-a19c44a47e41 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:34:15.455071 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c0004dc-e6b7-4efe-8004-a545fc575024 req-8d8b2e6c-ea3d-4b23-b604-a19c44a47e41 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 944 time: 0.1570516
May 28 14:34:15.501392 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4c0004dc-e6b7-4efe-8004-a545fc575024 req-8f226cd6-52a6-40f3-912b-e36efae89aef tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405846
May 28 14:34:16.692744 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 req-5e819c88-148d-4258-a330-c6dd70e98ff3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:16.694207 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 req-5e819c88-148d-4258-a330-c6dd70e98ff3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 944 time: 0.0864692
May 28 14:34:16.821118 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-de6f8ff5-e25b-4ee1-a8a0-0df15b897c88 req-d0447fe6-179b-40ad-a16a-37f6e1c8c6e0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1211331
May 28 14:34:17.530415 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:34:18.004838 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-224bf8d0-4893-4121-993b-ec67c43032fa req-56be226e-73d5-49c9-b087-f107a2ada1e9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:18.006259 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-224bf8d0-4893-4121-993b-ec67c43032fa req-56be226e-73d5-49c9-b087-f107a2ada1e9 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 944 time: 0.0818641
May 28 14:34:18.049964 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-224bf8d0-4893-4121-993b-ec67c43032fa req-82fc6f85-616d-47d3-9058-ecb3bfc9d1dd tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377059
May 28 14:34:19.245168 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7743edc6-f952-48b7-b432-df29eb0fee79 req-2a6a085e-a5cf-41e0-bb4f-1e37f82cb0d0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:19.247188 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7743edc6-f952-48b7-b432-df29eb0fee79 req-2a6a085e-a5cf-41e0-bb4f-1e37f82cb0d0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 944 time: 0.0809603
May 28 14:34:19.292939 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7743edc6-f952-48b7-b432-df29eb0fee79 req-2a45c7ef-dd64-453f-81cf-24a768beef6b tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397527
May 28 14:34:20.476252 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7505c792-a91a-411a-903a-976d0ccdb6fd req-0584bf86-217d-4d92-81f3-1b104150eced tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:20.477697 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7505c792-a91a-411a-903a-976d0ccdb6fd req-0584bf86-217d-4d92-81f3-1b104150eced tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 944 time: 0.0792022
May 28 14:34:20.521564 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7505c792-a91a-411a-903a-976d0ccdb6fd req-d3c140c8-d56b-43ea-b8f2-cf4701a0c03f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383120
May 28 14:34:21.845260 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aba3e526-4525-4a3a-bf71-4376383783c7 req-6b700d84-300a-4a33-bb03-cacb09497458 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:21.846681 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-aba3e526-4525-4a3a-bf71-4376383783c7 req-6b700d84-300a-4a33-bb03-cacb09497458 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 944 time: 0.0789721
May 28 14:34:21.890475 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-aba3e526-4525-4a3a-bf71-4376383783c7 req-398f61e9-5b2c-4f1c-b49d-f7a1e46d43c2 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382116
May 28 14:34:22.190188 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:34:22.320713 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:22.333622 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'port_id': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'mac_address': 'fa:16:3e:02:4b:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 867, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:34:22.390990 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:22.407119 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:34:22.422518 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:22.509080 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:22.510849 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:22.576376 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:22.583604 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586205 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586205 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586205 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586205 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586205 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586205 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586205 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586205 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586863 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.586863 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.587006 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:22.591832 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:22.919655 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['0c4d0a98-5c2e-401f-a013-9e7bf90a9c78'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:34:23.077203 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14e33264-790d-4d0b-b92c-05b720304067 req-91576d2f-3ea5-49bb-b78d-3bc3cf93dc51 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:23.078572 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-14e33264-790d-4d0b-b92c-05b720304067 req-91576d2f-3ea5-49bb-b78d-3bc3cf93dc51 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 945 time: 0.0843072
May 28 14:34:23.123229 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-14e33264-790d-4d0b-b92c-05b720304067 req-e65b22eb-1706-4461-b9f2-b6d106f3e4a3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388858
May 28 14:34:23.719332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bdec10f-10ff-42fb-963f-5280e7e56c4b req-819d8cc2-76c6-45c4-8cda-7bb321881755 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:23.720797 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6bdec10f-10ff-42fb-963f-5280e7e56c4b req-819d8cc2-76c6-45c4-8cda-7bb321881755 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0806561
May 28 14:34:23.769523 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6bdec10f-10ff-42fb-963f-5280e7e56c4b req-c40bd6ab-dcd2-47be-afde-6de3342e9351 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429087
May 28 14:34:24.205103 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:34:24.312015 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 req-14b08b51-ac4f-4296-9957-9150078757ac tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:24.313528 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 req-14b08b51-ac4f-4296-9957-9150078757ac tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 945 time: 0.0847211
May 28 14:34:24.358007 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-556737b2-c2fd-4daf-8fd7-8f60aedbe4c2 req-da947df1-0a5a-4a5b-8b99-82d239565d36 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388331
May 28 14:34:24.360176 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:34:24.365148 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:34:24.365526 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:24.480275 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:24.507946 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:34:24.518372 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:24.551474 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'code': 200}
May 28 14:34:24.583107 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:24.584980 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:24.650534 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:24.654124 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:24.952627 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6db976-d072-4dfe-a648-8b8c9ca8397d req-42018bc3-6ec8-430e-82f1-6b62512bf75e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:24.954081 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9a6db976-d072-4dfe-a648-8b8c9ca8397d req-42018bc3-6ec8-430e-82f1-6b62512bf75e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0799289
May 28 14:34:24.993451 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921d56e5-dc67-4788-ac8a-b7a1fe8fd051 req-8067106d-6b3a-430f-a84d-a06da5b2124c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:24.997654 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-921d56e5-dc67-4788-ac8a-b7a1fe8fd051 req-8067106d-6b3a-430f-a84d-a06da5b2124c service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 1099 time: 0.0687599
May 28 14:34:24.997889 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9a6db976-d072-4dfe-a648-8b8c9ca8397d req-b72f5c21-8b9e-433a-8319-47dad6978390 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0380578
May 28 14:34:25.037059 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-921d56e5-dc67-4788-ac8a-b7a1fe8fd051 req-99c138fe-d8cf-47d2-8f8d-867758aa8523 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0344741
May 28 14:34:25.547392 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 req-059f0e2f-e100-4ffe-9741-bfd26a89f598 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:25.548870 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 req-059f0e2f-e100-4ffe-9741-bfd26a89f598 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 946 time: 0.0838690
May 28 14:34:25.594220 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-31164b92-e9ad-48cd-8b3d-85b5d6636d94 req-9484b445-19b2-42b8-8af7-c3db4f2b52df tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397217
May 28 14:34:26.185389 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f1b197-15b1-42c9-be92-9b6291e20a2c req-594ea801-a0f1-48c5-a833-8b1158ec9416 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:26.186723 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c4f1b197-15b1-42c9-be92-9b6291e20a2c req-594ea801-a0f1-48c5-a833-8b1158ec9416 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0822423
May 28 14:34:26.231683 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c4f1b197-15b1-42c9-be92-9b6291e20a2c req-15a84c17-d9a6-4510-839e-1339e7660116 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393875
May 28 14:34:26.776524 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 req-1a02dc8e-c41c-4a92-ab5d-ff7caca6dcf1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:26.777966 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 req-1a02dc8e-c41c-4a92-ab5d-ff7caca6dcf1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 946 time: 0.0782051
May 28 14:34:26.822489 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0ad9c7fe-c4fd-4ab8-948f-0fe9bc296bf5 req-393aecd0-3e0f-4d85-9675-9547d8253831 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389018
May 28 14:34:27.015224 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 req-c45c41c3-2eb9-40e4-9799-994fa28e64f6 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:27.016723 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 req-c45c41c3-2eb9-40e4-9799-994fa28e64f6 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 946 time: 0.0843403
May 28 14:34:27.062984 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-f5d94fe1-3304-4e25-befd-0be0a906b1f7 req-45e99e94-bf7f-43e5-83ab-eeab214a8f7e tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405848
May 28 14:34:27.085289 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40206) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:34:27.263505 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dae1b619-8f5f-408f-ab53-0368114189d8 tempest-TestVolumeBootPattern-2072041258 tempest-TestVolumeBootPattern-2072041258-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:27.265313 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-dae1b619-8f5f-408f-ab53-0368114189d8 tempest-TestVolumeBootPattern-2072041258 tempest-TestVolumeBootPattern-2072041258-project-admin] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 1094 time: 0.1788831
May 28 14:34:27.267879 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40214) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:34:27.272877 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Request body: {'floatingip': {'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'port_id': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address': '172.20.0.10'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:34:27.279261 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:34:27.283024 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Usage tracker for resource:floatingip and tenant:c6d2d25991f04f00a48394ddbeec688e is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:34:27.286040 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:34:27.291900 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:34:27.420705 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 req-faaa6930-482f-41ec-90df-e49442eb4f80 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:27.422150 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 req-faaa6930-482f-41ec-90df-e49442eb4f80 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0839205
May 28 14:34:27.459377 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:27.466769 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ae00f0b7-c0d3-4a77-a4d4-090a1010c587 req-6bf3e8bc-5b76-4b2b-bafb-527f6755ecc8 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388889
May 28 14:34:27.596713 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:27.735393 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Allocated IP 172.27.3.236 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/4953c341-387b-4439-bdc5-e19ec4d55c34) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:34:27.886659 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:27.962206 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:27.990828 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:27.994573 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-78ee8cb6-8642-4a30-8fdb-ba8327a45418 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:28.054345 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:34:28.057165 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:34:28.060322 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:34:28.111357 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'Port': ['ID=4953c341-387b-4439-bdc5-e19ec4d55c34,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:28.124319 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.124700 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.125070 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.125435 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.125792 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.126150 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.126537 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.126890 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.127243 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.127618 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.127979 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.128323 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:34:28.131887 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:28.485374 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:28.767239 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:28.832494 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 req-905c6714-4f2c-438f-bac5-d4d746c3db5a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:28.833951 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 req-905c6714-4f2c-438f-bac5-d4d746c3db5a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.2603996
May 28 14:34:28.955935 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8042b78c-1f4f-4394-9958-4e13aad3fcd3 req-4469f2f9-70e8-4a02-9d56-f4febe32823d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1156535
May 28 14:34:29.022572 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:29.127972 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:29.131849 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:29.240119 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event updated for resources: {'Port': ['ID=4953c341-387b-4439-bdc5-e19ec4d55c34,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:29.243014 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:29.252849 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:29.425222 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.l3_db [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Floating IP fb034c57-b244-41cf-a063-880bd81b3bcc associated. External IP: 172.27.3.236, port: 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78.
May 28 14:34:29.771880 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Router 0cb62432-a4fe-4ba8-9099-f616594e4211 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:34:29.950451 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:34:29.960463 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] Sync routers for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:34:29.970235 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:34:29.970841 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba173ceb0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:34:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:34:30.025838 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-bca4c2af-b99e-4f22-aacb-a0824f5f226f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:30.036571 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:30.094539 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.8256145
May 28 14:34:30.095272 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:34:30.158851 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8727dde-b73f-4a71-947e-90f38f11ef12 req-7e6a18c6-7e88-453c-948f-ef2e33eaed28 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:30.163834 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:34:30.164553 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a8727dde-b73f-4a71-947e-90f38f11ef12 req-7e6a18c6-7e88-453c-948f-ef2e33eaed28 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.1001241
May 28 14:34:30.201864 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'status': 'completed', 'code': 200}
May 28 14:34:30.210899 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a8727dde-b73f-4a71-947e-90f38f11ef12 req-08290908-473f-4d29-aa45-aa5b6daa2471 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435710
May 28 14:34:30.300188 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3399e4d6-7033-45de-8330-10128f6baf03 req-89a944bb-447b-43f3-a3eb-eedd540a381a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:30.301565 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3399e4d6-7033-45de-8330-10128f6baf03 req-89a944bb-447b-43f3-a3eb-eedd540a381a service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 1099 time: 0.0762224
May 28 14:34:30.436175 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3399e4d6-7033-45de-8330-10128f6baf03 req-5526a1fa-2841-4570-83b2-4b264c936a54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:30.437611 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3399e4d6-7033-45de-8330-10128f6baf03 req-5526a1fa-2841-4570-83b2-4b264c936a54 service neutron] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 913 time: 0.1292043
May 28 14:34:30.559468 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba173ceb0>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'e141c6a5-bc74-487a-be63-addcf8e60750', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:49Z', 'updated_at': '2021-05-28T14:31:52Z', 'revision_number': 1, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}, {'id': 'fb034c57-b244-41cf-a063-880bd81b3bcc', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.236', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 614, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:02:4b:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:34:28Z', 'updated_at': '2021-05-28T14:34:28Z', 'revision_number': 0, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:34:30.559468 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] Checking router: 0cb62432-a4fe-4ba8-9099-f616594e4211 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:34:30.568060 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:34:30.568720 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba173ceb0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:34:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:34:30.635276 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3399e4d6-7033-45de-8330-10128f6baf03 req-80a37537-3d87-4b8e-b5a5-1abe5541f7d1 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 HTTP/1.1" status: 200  len: 1000 time: 0.1898379
May 28 14:34:30.700303 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3399e4d6-7033-45de-8330-10128f6baf03 req-4c23e8f8-455d-4da1-8dba-ca2ee43db09e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:30.702538 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3399e4d6-7033-45de-8330-10128f6baf03 req-4c23e8f8-455d-4da1-8dba-ca2ee43db09e service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.0587058
May 28 14:34:30.745967 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:34:30.783749 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3399e4d6-7033-45de-8330-10128f6baf03 req-77807e23-1c63-4f60-9859-94b71e5a3b78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:30.785196 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3399e4d6-7033-45de-8330-10128f6baf03 req-77807e23-1c63-4f60-9859-94b71e5a3b78 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0743470
May 28 14:34:30.921430 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3399e4d6-7033-45de-8330-10128f6baf03 req-ec45ee8e-84f0-4446-92af-1a860b5db3c2 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1283503
May 28 14:34:31.057417 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3399e4d6-7033-45de-8330-10128f6baf03 req-bd444929-d36b-4f4b-a30e-bfbffb278710 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1255109
May 28 14:34:31.094013 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba173ceb0>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'e141c6a5-bc74-487a-be63-addcf8e60750', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:49Z', 'updated_at': '2021-05-28T14:31:52Z', 'revision_number': 1, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}, {'id': 'fb034c57-b244-41cf-a063-880bd81b3bcc', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.236', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 614, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:02:4b:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:34:28Z', 'updated_at': '2021-05-28T14:34:28Z', 'revision_number': 0, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:34:31.097927 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14270b7e-2304-46e5-9ee9-19b495eba2b2 None None] The sync data for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi is: [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'e141c6a5-bc74-487a-be63-addcf8e60750', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:49Z', 'updated_at': '2021-05-28T14:31:52Z', 'revision_number': 1, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}, {'id': 'fb034c57-b244-41cf-a063-880bd81b3bcc', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.236', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 614, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:02:4b:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:34:28Z', 'updated_at': '2021-05-28T14:34:28Z', 'revision_number': 0, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:34:31.284017 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94ad36d8-b86b-4aea-bfc0-b084687c00b6 None None] New status for floating IP fb034c57-b244-41cf-a063-880bd81b3bcc: ACTIVE {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:34:31.399096 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e req-aa19b1f8-eee5-4590-a19d-06a8005da2b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:31.400512 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e req-aa19b1f8-eee5-4590-a19d-06a8005da2b6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0789692
May 28 14:34:31.449321 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ddb22c37-2629-4dc1-a3dd-f1e6fcda970e req-ed853542-c52a-46e5-92dc-bb4dca83eece tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0431590
May 28 14:34:32.549176 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:32.577842 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-eb1d0c56-1b72-4912-b1f5-0aa35df40606 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:32.638315 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 req-032ee2b5-7054-43b1-8f61-5b4c75c39a35 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:32.639881 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 req-032ee2b5-7054-43b1-8f61-5b4c75c39a35 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0815344
May 28 14:34:32.685473 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8f27d685-4fc4-4e39-b034-6ad45f700ab2 req-5efe8945-1cd6-4040-b4b5-96850b5b2f00 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395992
May 28 14:34:33.730119 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:33.959732 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6c39e2-d4be-4d0f-a774-9704aa62988d req-ece164e8-50ec-4f5c-a027-ac4a19b188cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:33.961138 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bb6c39e2-d4be-4d0f-a774-9704aa62988d req-ece164e8-50ec-4f5c-a027-ac4a19b188cd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.1722658
May 28 14:34:33.969484 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-2e8abe09-8c76-4f17-855c-aff74c9de91e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:33.970828 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-2e8abe09-8c76-4f17-855c-aff74c9de91e service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1099 time: 0.0755475
May 28 14:34:34.006729 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-bb6c39e2-d4be-4d0f-a774-9704aa62988d req-62878524-b13e-49a5-a6e3-5fde4f4b1b88 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396166
May 28 14:34:34.108593 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-dd3afbce-5e6f-4a00-89c9-037041ae8f7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:34.110023 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-dd3afbce-5e6f-4a00-89c9-037041ae8f7c service neutron] 10.222.0.90 "GET /v2.0/networks?id=cf0db8bd-5a73-44bf-9367-58867c9e819f HTTP/1.1" status: 200  len: 907 time: 0.1325676
May 28 14:34:34.211360 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-c8888e27-bf6b-4a24-83ea-9df7a98140c1 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5 HTTP/1.1" status: 200  len: 1002 time: 0.0913081
May 28 14:34:34.277251 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-4ba0fcf1-79e3-4c10-bc91-f44e7b1212fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:34.278531 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-4ba0fcf1-79e3-4c10-bc91-f44e7b1212fb service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4a437a5e-a3c1-4c29-a8be-fade6c84b5f4 HTTP/1.1" status: 200  len: 845 time: 0.0597653
May 28 14:34:34.357254 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-cfe937fe-b8cb-4489-a82d-86390311a376 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:34.358704 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-cfe937fe-b8cb-4489-a82d-86390311a376 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf0db8bd-5a73-44bf-9367-58867c9e819f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0675683
May 28 14:34:34.490249 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-e750f09c-49a8-47a7-91f6-2f255270f560 service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1216829
May 28 14:34:34.619136 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0de624a3-cf54-4c3a-a7be-7c189001c595 req-27571ca7-d016-4ad2-8c9e-4dcf0087d37d service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1219335
May 28 14:34:35.192616 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 req-680e79c0-a9a3-4bef-be8e-32776b8f91e9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:35.194070 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 req-680e79c0-a9a3-4bef-be8e-32776b8f91e9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0829327
May 28 14:34:35.238311 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1b1368cc-559d-46dc-85b9-fd16ab6d56a5 req-8773ef6e-9240-46e4-8c7e-3aab1e1a6dd0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387127
May 28 14:34:35.350535 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:35.611528 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780b189f-b62a-4444-9309-32deddcde087 req-fed3e803-02fe-4a0a-8fc3-d33931f27c60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:35.612972 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-780b189f-b62a-4444-9309-32deddcde087 req-fed3e803-02fe-4a0a-8fc3-d33931f27c60 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1099 time: 0.0715272
May 28 14:34:35.806697 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780b189f-b62a-4444-9309-32deddcde087 req-94e52b05-f91f-4f95-b1cf-e8bb2cf34aa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:35.808188 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-780b189f-b62a-4444-9309-32deddcde087 req-94e52b05-f91f-4f95-b1cf-e8bb2cf34aa6 service neutron] 10.222.0.90 "GET /v2.0/networks?id=cf0db8bd-5a73-44bf-9367-58867c9e819f HTTP/1.1" status: 200  len: 907 time: 0.1678200
May 28 14:34:35.998479 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-780b189f-b62a-4444-9309-32deddcde087 req-ad8879ea-3ac6-4bd5-9028-64c0fcd428da service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5 HTTP/1.1" status: 200  len: 1002 time: 0.1820552
May 28 14:34:36.065168 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780b189f-b62a-4444-9309-32deddcde087 req-7e9084e7-a5eb-4011-8d7a-da189e5e1471 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:36.066574 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-780b189f-b62a-4444-9309-32deddcde087 req-7e9084e7-a5eb-4011-8d7a-da189e5e1471 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4a437a5e-a3c1-4c29-a8be-fade6c84b5f4 HTTP/1.1" status: 200  len: 845 time: 0.0587168
May 28 14:34:36.141936 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780b189f-b62a-4444-9309-32deddcde087 req-5122b7f3-1f0e-4d4c-a4f6-95c04d914e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:36.143388 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-780b189f-b62a-4444-9309-32deddcde087 req-5122b7f3-1f0e-4d4c-a4f6-95c04d914e56 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf0db8bd-5a73-44bf-9367-58867c9e819f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0700226
May 28 14:34:36.275898 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-780b189f-b62a-4444-9309-32deddcde087 req-37752703-afc7-4286-8e94-1d2f2cea249a service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1251526
May 28 14:34:36.412820 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-780b189f-b62a-4444-9309-32deddcde087 req-81c3fcf9-4523-42a3-be33-f7ffc6c5f83f service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1296077
May 28 14:34:36.427428 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c3eccf-0156-4a0c-b869-3f02c34d85fe req-a2a67fe3-2007-41aa-ac79-f44a4f569b92 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:36.428881 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-57c3eccf-0156-4a0c-b869-3f02c34d85fe req-a2a67fe3-2007-41aa-ac79-f44a4f569b92 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0831940
May 28 14:34:36.473466 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-57c3eccf-0156-4a0c-b869-3f02c34d85fe req-077afe17-e044-4fc2-8992-e3044f02c73e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390193
May 28 14:34:37.659096 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31853a3f-4700-4a31-91d4-b5787a33f0c4 req-dcf94250-88d6-426b-b9af-d132fd61b1ff tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:37.660709 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-31853a3f-4700-4a31-91d4-b5787a33f0c4 req-dcf94250-88d6-426b-b9af-d132fd61b1ff tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0818238
May 28 14:34:37.709128 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-31853a3f-4700-4a31-91d4-b5787a33f0c4 req-c7e0b045-54a4-4f44-b9b6-1af0e7ac7dc3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426915
May 28 14:34:38.895011 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef85a17-8ea2-4a80-aa73-7f056590073f req-417af9f7-fd37-47f6-b326-bf6c936dfbca tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:38.896636 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4ef85a17-8ea2-4a80-aa73-7f056590073f req-417af9f7-fd37-47f6-b326-bf6c936dfbca tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0777318
May 28 14:34:38.944590 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4ef85a17-8ea2-4a80-aa73-7f056590073f req-411805dc-c7f0-493d-a1ea-97c5dfe3244d tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423477
May 28 14:34:39.456081 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3315e47-729d-47eb-9a56-704fbb034448 req-400869ad-807e-48c6-ab1f-e9d935f91c04 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:39.457557 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a3315e47-729d-47eb-9a56-704fbb034448 req-400869ad-807e-48c6-ab1f-e9d935f91c04 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0834141
May 28 14:34:39.502495 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a3315e47-729d-47eb-9a56-704fbb034448 req-4114bf47-1456-4aec-8d84-33ea7309aba1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391517
May 28 14:34:39.505862 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-c1b8ab3e-c819-48ba-8e74-dbb93697184d service neutron] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1176345
May 28 14:34:40.269616 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device e27f7a0e-7e77-4d61-a393-fe4fde4153d5 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:34:40.382583 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:40.408574 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:34:40.417837 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:40.449363 dv-cinder-791281-3-iscsi neutron-server[92696]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'code': 422} returned with failed status
May 28 14:34:40.498981 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:40.500808 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:40.568209 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,revision_number=6']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:40.571288 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:40.693878 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 req-f2e4b192-09d4-4a6a-9845-1df5133dc5f7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:40.695344 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 req-f2e4b192-09d4-4a6a-9845-1df5133dc5f7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0840654
May 28 14:34:40.740963 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6152b6e2-7651-4cca-8925-3fc32a5a24e2 req-15e9c6aa-87a0-40c3-8ae9-21f4a664ada7 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399272
May 28 14:34:41.924195 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee req-6de62862-ff02-449d-9993-0dfecfa71b42 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:41.925667 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee req-6de62862-ff02-449d-9993-0dfecfa71b42 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0805814
May 28 14:34:41.972984 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2dba28bc-d3aa-44b3-a051-1efd6fe09fee req-7e254dff-3bd7-421c-8129-18f193284ee3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415452
May 28 14:34:43.159201 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b330436-2129-4801-becb-9137d17309e3 req-5bb6b8c8-0f5d-4aae-8684-baa52f1863c9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:43.160745 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9b330436-2129-4801-becb-9137d17309e3 req-5bb6b8c8-0f5d-4aae-8684-baa52f1863c9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0823076
May 28 14:34:43.205185 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9b330436-2129-4801-becb-9137d17309e3 req-29faef47-ddec-412d-b78c-013c10227f85 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388324
May 28 14:34:44.397054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c29d8762-8bd6-4f2a-b506-c72b45193afe req-3d39d28d-d7a7-4780-9b1f-0b4309770bf3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:44.398527 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c29d8762-8bd6-4f2a-b506-c72b45193afe req-3d39d28d-d7a7-4780-9b1f-0b4309770bf3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0835748
May 28 14:34:44.442740 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c29d8762-8bd6-4f2a-b506-c72b45193afe req-f40df11f-1df2-45b2-a688-c00a4c1f63bf tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385702
May 28 14:34:44.758373 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-de5c3173-f857-48c3-b7a7-e363f49e3277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:44.759866 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-de5c3173-f857-48c3-b7a7-e363f49e3277 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c&tenant_id=26daec94fed843c8b74a9ff7d18ecdb5 HTTP/1.1" status: 200  len: 1097 time: 0.0736630
May 28 14:34:44.850176 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-b15643f2-7a1e-43f1-af9b-e4f73a286679 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:44.851661 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-b15643f2-7a1e-43f1-af9b-e4f73a286679 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1097 time: 0.0698266
May 28 14:34:44.982013 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-e00cc141-d6f9-4c2a-a76b-6ef54768d254 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:44.983477 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-e00cc141-d6f9-4c2a-a76b-6ef54768d254 service neutron] 10.222.0.90 "GET /v2.0/networks?id=cf0db8bd-5a73-44bf-9367-58867c9e819f HTTP/1.1" status: 200  len: 907 time: 0.1248238
May 28 14:34:45.093121 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-2491aef3-686c-4561-9fb7-53108f66caf8 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5 HTTP/1.1" status: 200  len: 1000 time: 0.0962923
May 28 14:34:45.159138 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-c514cbf2-5e7c-496a-a0b7-e104d6503000 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:45.160591 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-c514cbf2-5e7c-496a-a0b7-e104d6503000 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4a437a5e-a3c1-4c29-a8be-fade6c84b5f4 HTTP/1.1" status: 200  len: 845 time: 0.0574381
May 28 14:34:45.237857 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-a76c07bb-0d0c-4ed6-993e-819543eb9238 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:45.239276 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-a76c07bb-0d0c-4ed6-993e-819543eb9238 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf0db8bd-5a73-44bf-9367-58867c9e819f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0712519
May 28 14:34:45.378119 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-c05b6a1d-1cd8-445c-b431-c89d9cefd92d service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1273110
May 28 14:34:45.618396 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b9a6b045-c310-4876-b508-485a5aa2d438 req-f9d81dab-a6f1-466c-9d98-c87bc30e307e service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2331476
May 28 14:34:45.639137 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c8c5484-45cb-4579-9cf9-e9032facf449 req-8620d261-d580-4298-b5a4-4de35ab3afe8 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:45.640526 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4c8c5484-45cb-4579-9cf9-e9032facf449 req-8620d261-d580-4298-b5a4-4de35ab3afe8 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0901437
May 28 14:34:45.686552 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-4c8c5484-45cb-4579-9cf9-e9032facf449 req-851f6072-04c9-4241-8c47-7e4783beb63a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403550
May 28 14:34:46.873857 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243338cb-66f2-4c5c-a5b7-0be0462c20cd req-3ae87695-ca71-426c-9f16-dcb7be4a6c0a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:46.875337 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-243338cb-66f2-4c5c-a5b7-0be0462c20cd req-3ae87695-ca71-426c-9f16-dcb7be4a6c0a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0805886
May 28 14:34:46.919671 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-243338cb-66f2-4c5c-a5b7-0be0462c20cd req-97e468ed-52a2-4e0b-afbf-b5ac608c6d54 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0384901
May 28 14:34:48.101280 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 req-ae7752a3-c7fd-4f4e-b4d8-8ce584bb0b0c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:48.102589 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 req-ae7752a3-c7fd-4f4e-b4d8-8ce584bb0b0c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0803795
May 28 14:34:48.147730 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-26713bca-b577-46ca-b6a4-a2a4e69d4b17 req-f66addeb-5cd9-43a1-8486-e645ad3e94ac tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391712
May 28 14:34:49.332120 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfbb261f-d99f-427a-bc0d-cb60852eed9f req-f444432c-8aa7-457d-ab98-da037ca35940 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:49.333537 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dfbb261f-d99f-427a-bc0d-cb60852eed9f req-f444432c-8aa7-457d-ab98-da037ca35940 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0816112
May 28 14:34:49.376971 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dfbb261f-d99f-427a-bc0d-cb60852eed9f req-3131eb8f-1c5f-4d2a-8cf9-af9e247b39f4 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0378978
May 28 14:34:50.568153 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0c7134-109b-456d-8f96-dee82beaeb7e req-299234cd-f426-4055-8e89-8da910e95aef tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:50.569598 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ed0c7134-109b-456d-8f96-dee82beaeb7e req-299234cd-f426-4055-8e89-8da910e95aef tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0828679
May 28 14:34:50.613445 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ed0c7134-109b-456d-8f96-dee82beaeb7e req-14462aa0-e734-4024-84a3-dc3f2488b8ad tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382960
May 28 14:34:51.798752 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 req-06c92135-a75f-40c5-9335-24b0125faab1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:51.800262 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 req-06c92135-a75f-40c5-9335-24b0125faab1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0807710
May 28 14:34:51.843896 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-dd440d0d-c510-4355-9ea4-e1e9c0352a13 req-4c95c397-3c0d-4e6e-bf31-bc2858ee98fa tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0374095
May 28 14:34:53.024949 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 req-88c886a2-b052-4c28-bd52-9ca5f6439571 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:53.026377 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 req-88c886a2-b052-4c28-bd52-9ca5f6439571 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0783527
May 28 14:34:53.074566 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dad3d914-f7cd-41ba-82ab-e7ea0d810eb1 req-f79a3e5a-d109-427a-a88f-9493714274a9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0424812
May 28 14:34:54.258788 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf req-97edb507-7161-47ec-a386-26462d198c33 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:54.260249 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf req-97edb507-7161-47ec-a386-26462d198c33 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0828354
May 28 14:34:54.305520 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-34e2914a-ecdf-47ac-96b4-39d5a4736cdf req-106ce52a-3765-4de6-a8f1-efd7c92c5148 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396931
May 28 14:34:54.529068 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:34:55.487057 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5a4435e-8b9a-468c-acd9-972330a806f4 req-d4a42bd8-1017-4a0c-ac42-0d3d44fc2ac5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:55.488482 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a5a4435e-8b9a-468c-acd9-972330a806f4 req-d4a42bd8-1017-4a0c-ac42-0d3d44fc2ac5 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 944 time: 0.0804064
May 28 14:34:55.533629 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a5a4435e-8b9a-468c-acd9-972330a806f4 req-5d5dd4f6-6532-4e41-94ae-ed55a34d0d96 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395670
May 28 14:34:56.328249 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device e27f7a0e-7e77-4d61-a393-fe4fde4153d5 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:34:56.459331 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:56.472386 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'port_id': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'mac_address': 'fa:16:3e:01:e1:b6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 880, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:34:56.526394 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:56.543350 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e27f7a0e-7e77-4d61-a393-fe4fde4153d5 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:34:56.558576 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:56.652561 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:56.654363 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:56.715199 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51228cba-f288-4f3a-b502-fe77944f103f req-5122d372-bb29-4d37-a543-5894138c0cb3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:56.716667 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51228cba-f288-4f3a-b502-fe77944f103f req-5122d372-bb29-4d37-a543-5894138c0cb3 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 945 time: 0.0799456
May 28 14:34:56.723912 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,revision_number=7']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:56.727030 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:56.766593 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-51228cba-f288-4f3a-b502-fe77944f103f req-94b58bfe-f614-4501-803e-0877ebf27d4e tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0432780
May 28 14:34:57.087309 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['e27f7a0e-7e77-4d61-a393-fe4fde4153d5'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:34:57.936500 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:57.960153 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43592acd-a780-4c0e-8f17-82ae3c38b8ee req-3ee12c6a-84af-4893-bca0-72e7459e9438 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:57.961596 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-43592acd-a780-4c0e-8f17-82ae3c38b8ee req-3ee12c6a-84af-4893-bca0-72e7459e9438 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 945 time: 0.0856440
May 28 14:34:58.004925 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-43592acd-a780-4c0e-8f17-82ae3c38b8ee req-712551a7-77e6-4030-bac1-79ee57d7f0b0 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377510
May 28 14:34:58.358252 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device e27f7a0e-7e77-4d61-a393-fe4fde4153d5 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:34:58.425310 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:34:58.425680 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:58.573467 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:58.599594 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:34:58.610623 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:34:58.647223 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'code': 200}
May 28 14:34:58.692119 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:34:58.694650 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:34:58.763677 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,revision_number=8']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:34:58.767778 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:34:58.990020 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d5893f6-53ef-4ca7-bf55-0a5f022e1e93 req-60cd5404-ccc1-4503-b9d9-5900a6434440 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:58.991465 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d5893f6-53ef-4ca7-bf55-0a5f022e1e93 req-60cd5404-ccc1-4503-b9d9-5900a6434440 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1099 time: 0.0696797
May 28 14:34:59.032343 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d5893f6-53ef-4ca7-bf55-0a5f022e1e93 req-af19d0ee-3eab-4734-9378-cbcc6747f2aa service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0339882
May 28 14:34:59.184774 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 req-7719856d-7551-46a2-ba31-4a74e9367d66 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:34:59.186222 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 req-7719856d-7551-46a2-ba31-4a74e9367d66 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0795319
May 28 14:34:59.229834 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-11f6403e-7c68-4048-b4f4-d6fa21d82f84 req-5d73e1e2-c93b-49d0-adc2-5d76bad7fb01 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0380020
May 28 14:34:59.989154 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a2c74dfb-fc28-4ae3-9bb2-5f1dbf72ba41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:00.430579 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf557c0-45a5-4521-9227-221e66b0d53e req-5260118e-a545-40d5-87d5-cdc61641750a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:00.432189 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf557c0-45a5-4521-9227-221e66b0d53e req-5260118e-a545-40d5-87d5-cdc61641750a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0861845
May 28 14:35:00.476207 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf557c0-45a5-4521-9227-221e66b0d53e req-b607e140-0ac3-4f67-b4b7-13d5863ffeb9 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382829
May 28 14:35:01.660982 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb75f81-4b41-40bd-8f23-75500c2036ac req-7c7a981b-321e-4b0e-98b2-48011569dcfc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:01.662425 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6fb75f81-4b41-40bd-8f23-75500c2036ac req-7c7a981b-321e-4b0e-98b2-48011569dcfc tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.0827367
May 28 14:35:01.705817 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6fb75f81-4b41-40bd-8f23-75500c2036ac req-1c69257b-39f1-42b6-a9c5-c509d4ad8c91 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377927
May 28 14:35:02.520850 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:02.541769 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-ae29a55f-b844-4b33-b601-141dc667edda None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:03.718945 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:05.343534 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:27.971217 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:29.378505 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff req-5d09a948-9856-4dbd-85d3-3fe51df1999a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:29.379972 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff req-5d09a948-9856-4dbd-85d3-3fe51df1999a tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 946 time: 0.0802391
May 28 14:35:29.428703 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0568a7f3-3ad7-4f72-b024-46bee4ecb6ff req-ec3b460a-72e9-4d41-bbac-a5333735430c tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0429866
May 28 14:35:30.011314 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-99fa06d5-d6d9-433a-b465-787f6a95ab58 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:30.637299 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d5d99c-88df-4a98-85ec-6379699786dc req-7de79196-83c4-4019-a854-69374d00d192 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:30.638743 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a7d5d99c-88df-4a98-85ec-6379699786dc req-7de79196-83c4-4019-a854-69374d00d192 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 946 time: 0.0801437
May 28 14:35:30.683029 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a7d5d99c-88df-4a98-85ec-6379699786dc req-f2dc3424-2b97-458e-a4d5-19740d130004 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0386555
May 28 14:35:31.213898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-812cea5b-e979-4ee9-8fb8-66933d2b1e2f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:31.215315 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-812cea5b-e979-4ee9-8fb8-66933d2b1e2f tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 946 time: 0.0814676
May 28 14:35:31.353592 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Deleting port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:35:31.354784 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:31.486796 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] For port 65e6ef94-43dd-499b-b9bb-2e42a8536b59, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=65e6ef94-43dd-499b-b9bb-2e42a8536b59,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:35:31.487141 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:31.527268 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:35:31.768668 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:31.769243 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:31.769243 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.l3_db [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Floating IP ad224509-05f5-49ff-bcce-8640d345cf54 disassociated. External IP: 172.27.3.125, port: 65e6ef94-43dd-499b-b9bb-2e42a8536b59.
May 28 14:35:31.769671 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling delete_port for 65e6ef94-43dd-499b-b9bb-2e42a8536b59 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:35:31.873104 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf466d9-f0b5-4a04-9550-7a08dbef4391 req-bac8d681-62a2-4d40-ab12-1cc60ecf97ec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:31.874610 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-adf466d9-f0b5-4a04-9550-7a08dbef4391 req-bac8d681-62a2-4d40-ab12-1cc60ecf97ec tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 946 time: 0.0813441
May 28 14:35:31.919635 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-adf466d9-f0b5-4a04-9550-7a08dbef4391 req-9bc09a45-923e-4d45-9bb3-dcc05a59d4f1 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups?id=ab91613c-a89d-4274-9712-4be0d63eeb3e&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0393353
May 28 14:35:31.948175 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:31.955149 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5f684d6f-cc7a-4830-ad0a-fb80e9e4b2e7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:32.003707 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event deleted for resources: {'Port': ['ID=65e6ef94-43dd-499b-b9bb-2e42a8536b59,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:32.061608 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.061974 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.062363 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.062720 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.063072 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.063419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.063816 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.064160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.064509 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.064849 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.065190 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.065531 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:32.073355 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:32.282877 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Router 93611a0c-a5d3-438a-bf94-7453623f231d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:35:32.467510 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:35:32.476786 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] Sync routers for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:35:32.487155 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:35:32.487804 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2881070>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:35:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:32.543720 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:32.544689 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] No DVR routers for this DVR port 65e6ef94-43dd-499b-b9bb-2e42a8536b59 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:35:32.547162 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:32.549782 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-deleted', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:35:32.554793 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-784173ce-1b2c-4d83-b69a-332a716ecec9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:32.596672 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd654fce7-a7f9-4505-bb9a-de526002e464', 'name': 'network-vif-deleted', 'tag': '65e6ef94-43dd-499b-b9bb-2e42a8536b59', 'status': 'completed', 'code': 200}
May 28 14:35:32.629203 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-16f2e9b6-2985-4ce6-bedc-351783d9d453 req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.90 "DELETE /v2.0/ports/65e6ef94-43dd-499b-b9bb-2e42a8536b59 HTTP/1.1" status: 204  len: 173 time: 1.4076004
May 28 14:35:32.671959 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:35:32.986955 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2881070>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:32.990792 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] Checking router: 93611a0c-a5d3-438a-bf94-7453623f231d for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:35:33.000065 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:35:33.000668 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2881070>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:35:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:33.089565 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-1bad5471-20ab-47e5-9910-8231f17dd7ae req-b79ef270-63e8-48e9-916c-51808721aff0 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/ports?device_id=d654fce7-a7f9-4505-bb9a-de526002e464 HTTP/1.1" status: 200  len: 210 time: 0.0446270
May 28 14:35:33.181863 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:35:33.501146 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2881070>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:33.505152 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2079f461-3160-4d4e-8711-057e582c2d28 None None] The sync data for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi is: [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '376cfe1f-23f1-4d2e-a93c-9a98a3effcca', 'name': '', 'network_id': '936c4847-d3d4-4250-b543-dc72dd308858', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'mac_address': 'fa:16:3e:0c:fb:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:13Z', 'updated_at': '2021-05-28T14:21:24Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'subnets': [{'id': 'a33b117b-9151-4e0d-a39e-2f027719309f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:35:33.704372 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-388b0ece-29c5-4924-b3c8-7ebdfb0f2e51 None None] New status for floating IP ad224509-05f5-49ff-bcce-8640d345cf54: DOWN {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:35:33.713716 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:34.303529 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40364) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:34.370164 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-63b32588-3c41-4800-b913-f558b5f79b6d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:34.397650 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-63b32588-3c41-4800-b913-f558b5f79b6d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:34.507844 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-63b32588-3c41-4800-b913-f558b5f79b6d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:34.512578 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-2febfa10-5670-4c4c-986c-d97d236a7d57 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:34.517568 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 65e6ef94-43dd-499b-b9bb-2e42a8536b59 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:35:34.530784 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63b32588-3c41-4800-b913-f558b5f79b6d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab91613c-a89d-4274-9712-4be0d63eeb3e,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:34.533415 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-63b32588-3c41-4800-b913-f558b5f79b6d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:34.558904 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 65e6ef94-43dd-499b-b9bb-2e42a8536b59 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:35:34.559177 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 65e6ef94-43dd-499b-b9bb-2e42a8536b59 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:35:34.598554 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-63b32588-3c41-4800-b913-f558b5f79b6d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:34.599717 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-63b32588-3c41-4800-b913-f558b5f79b6d tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /v2.0/security-groups/ab91613c-a89d-4274-9712-4be0d63eeb3e HTTP/1.1" status: 204  len: 168 time: 0.2951422
May 28 14:35:34.602511 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40368) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:34.618217 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.api.v2.resource [None req-1b453c22-56be-45d4-8398-863eb4c85ffe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] show failed (client error): The resource could not be found.
May 28 14:35:34.619430 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-1b453c22-56be-45d4-8398-863eb4c85ffe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "GET /v2.0/security-groups/ab91613c-a89d-4274-9712-4be0d63eeb3e HTTP/1.1" status: 404  len: 347 time: 0.0157866
May 28 14:35:34.622657 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40372) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:34.834769 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Deleting port 97cc32c9-c8a9-4481-a623-39942c9723c4 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:35:34.835136 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:34.951325 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:34.951677 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:35.077394 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Calling delete_port for 97cc32c9-c8a9-4481-a623-39942c9723c4 owned by network:floatingip {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:35:35.239184 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:35.243687 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:35.316867 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Pushing event deleted for resources: {'Port': ['ID=97cc32c9-c8a9-4481-a623-39942c9723c4,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:35.324214 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:35.342411 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:35.390980 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks [] for floatingip, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:35.404612 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:35.405720 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-a677c2d7-3b09-41a3-85e8-d231883c35d4 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] 10.222.0.59 "DELETE /v2.0/floatingips/ad224509-05f5-49ff-bcce-8640d345cf54 HTTP/1.1" status: 204  len: 168 time: 0.7821929
May 28 14:35:35.547278 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-0d3e1951-d6a1-4676-914e-06ed41c18869 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0733569
May 28 14:35:35.687625 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-33ad83fc-a2a1-426f-ad8c-6d2d121c3f52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:35.689275 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-33ad83fc-a2a1-426f-ad8c-6d2d121c3f52 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 1098 time: 0.0719793
May 28 14:35:35.933454 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-c5cfd544-2425-4feb-a094-7f5416e8e51c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:35.934934 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-c5cfd544-2425-4feb-a094-7f5416e8e51c service neutron] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 913 time: 0.2259374
May 28 14:35:36.039308 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-ff87a12d-69ce-4afd-a266-aac379323ffd service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b HTTP/1.1" status: 200  len: 1000 time: 0.0965662
May 28 14:35:36.101726 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-82e0bcbe-c1cd-464c-90a5-b01037debdea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:36.103112 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-82e0bcbe-c1cd-464c-90a5-b01037debdea service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.0567696
May 28 14:35:36.182821 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-3fd8cea1-b4f6-40e5-81df-3ef78ea87be2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:36.184319 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-3fd8cea1-b4f6-40e5-81df-3ef78ea87be2 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0745373
May 28 14:35:36.317581 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-d806a214-095f-4576-94ac-b82205f45bf4 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1261744
May 28 14:35:36.453938 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5a6e245f-a096-4b7c-a683-ed6deba9c24f req-7f2aab64-bfa6-482a-a061-f72188c34868 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1291358
May 28 14:35:38.501192 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40400) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:39.168470 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-681900'] for router_interface, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:39.663547 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Deleting port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:35:39.664277 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:39.781589 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] For port 376cfe1f-23f1-4d2e-a93c-9a98a3effcca, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=376cfe1f-23f1-4d2e-a93c-9a98a3effcca,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:35:39.781941 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:39.905443 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Calling delete_port for 376cfe1f-23f1-4d2e-a93c-9a98a3effcca owned by network:router_interface {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:35:40.239237 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:40.243044 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:40.291342 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Pushing event deleted for resources: {'Port': ['ID=376cfe1f-23f1-4d2e-a93c-9a98a3effcca,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:40.317824 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:40.552981 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551923', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-685116'] for router_interface, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:41.007815 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Router 93611a0c-a5d3-438a-bf94-7453623f231d has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:35:41.184357 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:35:41.196297 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] Sync routers for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:35:41.199224 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5d607182-dd2f-494e-bf13-aab155bd2cfb admin admin] 10.222.0.59 "PUT /v2.0/routers/93611a0c-a5d3-438a-bf94-7453623f231d/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6963885
May 28 14:35:41.201838 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40406) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:41.208275 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:35:41.208953 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba17f7610>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:35:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:41.376488 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks [] for router, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:41.424629 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:35:41.550930 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:41.684972 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Deleting port 06123ab5-7778-4ce3-914e-df22dfe564c6 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:35:41.685204 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:41.702926 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba17f7610>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30'}], 'enable_snat': True}, 'gw_port_id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:35:40Z', 'revision_number': 5, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port': {'id': '06123ab5-7778-4ce3-914e-df22dfe564c6', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:6b:82:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:21:07Z', 'updated_at': '2021-05-28T14:21:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:41.706781 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] Checking router: 93611a0c-a5d3-438a-bf94-7453623f231d for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:35:41.715015 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] Routers {'93611a0c-a5d3-438a-bf94-7453623f231d'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:35:41.715648 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba17f7610>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:35:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['93611a0c-a5d3-438a-bf94-7453623f231d'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:41.810341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] For port 06123ab5-7778-4ce3-914e-df22dfe564c6, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=06123ab5-7778-4ce3-914e-df22dfe564c6,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:35:41.810700 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:41.868398 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] Set router 93611a0c-a5d3-438a-bf94-7453623f231d gateway port host: None {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:35:41.936283 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Calling delete_port for 06123ab5-7778-4ce3-914e-df22dfe564c6 owned by network:router_gateway {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:35:41.973211 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba17f7610>, [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:35:41Z', 'revision_number': 6, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port_host': None}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:41.977155 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5bc035e-ac7a-4acb-9638-20ead0740134 None None] The sync data for ids ['93611a0c-a5d3-438a-bf94-7453623f231d'] in dv-cinder-791281-3-iscsi is: [{'id': '93611a0c-a5d3-438a-bf94-7453623f231d', 'name': 'tempest-AttachVolumeShelveTestJSON-1675679885-router', 'tenant_id': '3bbdb80ac64d4db395d276876322e7b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:21:05Z', 'updated_at': '2021-05-28T14:35:41Z', 'revision_number': 6, 'project_id': '3bbdb80ac64d4db395d276876322e7b0', 'gw_port_host': None}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:35:42.147856 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:42.152321 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-38efce28-f1ef-4a7f-a78c-23a41a70d7c3 tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:42.198007 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Pushing event deleted for resources: {'Port': ['ID=06123ab5-7778-4ce3-914e-df22dfe564c6,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:42.200903 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:42.288566 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-682161'] for router_gateway, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:42.572633 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-685628', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31078'] for router, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:42.575396 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:42.644864 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-684032'] for router, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:42.645415 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 93611a0c-a5d3-438a-bf94-7453623f231d {{(pid=92695) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 28 14:35:42.658910 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:42.660047 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] 10.222.0.59 "DELETE /v2.0/routers/93611a0c-a5d3-438a-bf94-7453623f231d HTTP/1.1" status: 204  len: 168 time: 1.4573045
May 28 14:35:42.662761 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40410) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:42.728536 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-fafb86e0-fe63-4eaf-b6a4-3b17e16d8294 admin admin] Deleting subnet a33b117b-9151-4e0d-a39e-2f027719309f {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:35:42.731650 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fafb86e0-fe63-4eaf-b6a4-3b17e16d8294 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:42.781056 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fafb86e0-fe63-4eaf-b6a4-3b17e16d8294 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1610776'] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:42.861216 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fafb86e0-fe63-4eaf-b6a4-3b17e16d8294 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.186784 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fafb86e0-fe63-4eaf-b6a4-3b17e16d8294 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1635750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1808149'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.191878 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c4a94e45-93e7-4f4b-b3c4-523eaa4878a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:43.233505 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 376cfe1f-23f1-4d2e-a93c-9a98a3effcca no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:35:43.234114 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fafb86e0-fe63-4eaf-b6a4-3b17e16d8294 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a33b117b-9151-4e0d-a39e-2f027719309f,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:43.235963 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-fafb86e0-fe63-4eaf-b6a4-3b17e16d8294 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.243525 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-fafb86e0-fe63-4eaf-b6a4-3b17e16d8294 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:43.243525 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-fafb86e0-fe63-4eaf-b6a4-3b17e16d8294 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/a33b117b-9151-4e0d-a39e-2f027719309f HTTP/1.1" status: 204  len: 168 time: 0.5785718
May 28 14:35:43.245011 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40414) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:43.259811 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb8a9e13-5763-47aa-9528-f636d224e03a None None] Network 936c4847-d3d4-4250-b543-dc72dd308858 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:35:43.286017 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 376cfe1f-23f1-4d2e-a93c-9a98a3effcca {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:35:43.286438 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 376cfe1f-23f1-4d2e-a93c-9a98a3effcca not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:35:43.286786 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 06123ab5-7778-4ce3-914e-df22dfe564c6 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:35:43.351829 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.374129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 06123ab5-7778-4ce3-914e-df22dfe564c6 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:35:43.374474 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 06123ab5-7778-4ce3-914e-df22dfe564c6 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:35:43.424771 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Deleting port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:35:43.425026 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.527068 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] For port 62bcf3bb-40c5-4ec7-b933-6b748b550d19, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=62bcf3bb-40c5-4ec7-b933-6b748b550d19,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:35:43.527428 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.555266 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] DHCP port deletion for 936c4847-d3d4-4250-b543-dc72dd308858 request from dv-cinder-791281-3-iscsi {{(pid=92696) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 28 14:35:43.619274 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Deleting port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 {{(pid=92696) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:35:43.619681 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.649519 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Calling delete_port for 62bcf3bb-40c5-4ec7-b933-6b748b550d19 owned by network:dhcp {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:35:43.717740 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] For port 62bcf3bb-40c5-4ec7-b933-6b748b550d19, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=62bcf3bb-40c5-4ec7-b933-6b748b550d19,segment=NetworkSegment(98da8543-e1f7-4222-b523-eef6806a46f7),segment_id=98da8543-e1f7-4222-b523-eef6806a46f7)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:35:43.718129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.803883 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.808368 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eb5bad2f-a112-477b-b712-3a846f2b3ddb tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:43.839681 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Calling delete_port for 62bcf3bb-40c5-4ec7-b933-6b748b550d19 owned by network:dhcp {{(pid=92696) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:35:43.854276 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Pushing event deleted for resources: {'Port': ['ID=62bcf3bb-40c5-4ec7-b933-6b748b550d19,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:43.857939 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:43.858769 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] No DVR routers for this DVR port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 on host dv-cinder-791281-3-iscsi {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:35:43.886586 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980'] for port, after_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.891668 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:43.969440 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Pushing event deleted for resources: {'Port': ['ID=62bcf3bb-40c5-4ec7-b933-6b748b550d19,revision_number=None']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:43.974089 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] No DVR routers for this DVR port 62bcf3bb-40c5-4ec7-b933-6b748b550d19 on host dv-cinder-791281-3-iscsi {{(pid=92696) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:35:43.980797 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.981092 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.981383 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.981702 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.982032 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.982362 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.982688 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.983009 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.983331 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.983906 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.983993 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.984280 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:43.986943 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:43.987224 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-038e21bb-fd1b-4109-9a47-9ae40c8ade02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:44.001079 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba1e1aa00>,) {'filters': {'network_id': ['936c4847-d3d4-4250-b543-dc72dd308858']}} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:44.013004 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba1e1aa00>, '98da8543-e1f7-4222-b523-eef6806a46f7') {'for_net_delete': True} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:44.013301 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba1e1aa00>, '98da8543-e1f7-4222-b523-eef6806a46f7') {} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:44.024152 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1610771'] for segment, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:44.039253 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:44.045733 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Releasing vlan 869 on physical network physnet1 to pool {{(pid=92695) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:35:44.046128 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1697792'] for segment, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]: Traceback (most recent call last):
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     timer()
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     cb(*args, **kw)
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     return func(*args, **kwargs)
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     self._notify()
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     self.callback(batched_events)
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     event.method(event)
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     return f(self, *a, **k)
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._get(url).json()
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self.request(url, 'GET', **kwargs)
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:35:44.059593 dv-cinder-791281-3-iscsi neutron-server[92695]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:35:44.176213 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:44.179774 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8f4fbc05-5945-44d9-a62d-c54d431c910d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:44.192388 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:44.203501 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Pushing event deleted for resources: {'Network': ['ID=936c4847-d3d4-4250-b543-dc72dd308858,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:44.207464 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:44.257499 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c3dafbc1-b286-481a-b13e-86ff85083d36 admin admin] 10.222.0.59 "DELETE /v2.0/networks/936c4847-d3d4-4250-b543-dc72dd308858 HTTP/1.1" status: 204  len: 168 time: 1.0112841
May 28 14:35:44.595762 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40420) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:44.643804 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-75be711c-465a-4e01-b7a9-52e55046a875 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=3bbdb80ac64d4db395d276876322e7b0&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0468137
May 28 14:35:44.646071 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40424) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:44.704057 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-64b4b4a5-5694-486e-a80c-6da867823f21 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:44.729425 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-64b4b4a5-5694-486e-a80c-6da867823f21 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:44.856196 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-64b4b4a5-5694-486e-a80c-6da867823f21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:44.860410 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc4a14f9-8d15-4671-8130-1fd729d1fe84 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:44.877847 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64b4b4a5-5694-486e-a80c-6da867823f21 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7affb313-fe4a-4430-8208-78a4fadec415,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:44.881646 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-64b4b4a5-5694-486e-a80c-6da867823f21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:44.884871 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-64b4b4a5-5694-486e-a80c-6da867823f21 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:44.886452 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-64b4b4a5-5694-486e-a80c-6da867823f21 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7affb313-fe4a-4430-8208-78a4fadec415 HTTP/1.1" status: 204  len: 168 time: 0.2395148
May 28 14:35:45.231129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 62bcf3bb-40c5-4ec7-b933-6b748b550d19 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:35:45.265977 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 62bcf3bb-40c5-4ec7-b933-6b748b550d19 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:35:45.266324 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 62bcf3bb-40c5-4ec7-b933-6b748b550d19 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:35:45.987490 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40450) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:46.089945 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-84730337-network', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:35:46.094604 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:35:46.098506 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Usage tracker for resource:network and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:35:46.101363 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:35:46.211491 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:35:46.283308 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Made reservation on behalf of 61d5abfd60c747b5ad4bdeb820132545 for: {'network': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:35:46.285726 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7961634'] for network, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:46.298003 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:46.312258 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:35:46.316068 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Usage tracker for resource:security_group_rule and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:35:46.318935 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:35:46.325159 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:35:46.411330 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:46.466234 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:46.469395 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0e8e221b-6ff6-4742-a788-5197b92d7d90 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:46.497597 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] vlan segment allocate from pool success with {'vlan_id': 851, 'physical_network': 'physnet1'}  {{(pid=92695) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 28 14:35:46.506116 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07daab05-f59c-4c6f-a818-063c4ca15904,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:46.509823 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:46.513000 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:46.513336 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.segments_db [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Added segment 7e96cd57-3fa8-4cba-8c1a-78ddd0b13668 of type vlan for network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc
May 28 14:35:46.540041 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8777742281045'] for network, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:46.650414 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930'] for network, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:46.651778 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:46.652367 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:46.657415 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:46.757596 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Pushing event updated for resources: {'Network': ['ID=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:46.760180 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:46.768519 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc details requested by agent ovs-agent-dv-cinder-791281-3-iscsi with host dv-cinder-791281-3-iscsi {{(pid=92696) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 28 14:35:46.822456 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] 10.222.0.59 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.8338666
May 28 14:35:46.825761 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40456) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:46.831507 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Request body: {'subnet': {'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-84730337-subnet', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:35:46.836375 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:35:46.840300 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Usage tracker for resource:subnet and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:35:46.843137 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:35:46.853486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:35:46.924688 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Made reservation on behalf of 61d5abfd60c747b5ad4bdeb820132545 for: {'subnet': 1} {{(pid=92694) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:35:46.927022 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3521847'] for subnet, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:47.446222 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483451', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3521825'] for subnet, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:47.450023 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:47.528730 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=097b2b8c-d0d5-4b10-a710-a27ac2380514,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:47.539987 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Checking segment: {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92694) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:35:47.540341 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Network hostable DHCP agents. Network: d07aad82-58f0-48c7-bdbc-4ebfe5f698dc, hostable agents: ['45240f3e-06a3-448c-95d7-c669f21fbb5c'], hosted agents: [] {{(pid=92694) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 28 14:35:47.543760 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.544153 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.544528 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.544898 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.545267 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.545634 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.546004 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.546364 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.546725 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.547084 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.547440 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.547820 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:47.551949 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:47.610188 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc is scheduled to be hosted by DHCP agent 45240f3e-06a3-448c-95d7-c669f21fbb5c with binding_index 1 {{(pid=92694) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 28 14:35:47.684660 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791281-3-iscsi, d07aad82-58f0-48c7-bdbc-4ebfe5f698dc) {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:35:47.693596 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:47.704102 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:47.704270 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b98c9ee-61ff-433a-a4b6-23f027b74139 None None] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:35:47.805492 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] 10.222.0.59 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.9785159
May 28 14:35:47.808425 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40460) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:47.813868 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:35:47.818788 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:35:47.824254 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Usage tracker for resource:router and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:35:47.826272 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:35:47.832174 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:35:47.907952 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-685791', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30996'] for router, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:47.909010 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-687583', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-681984', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-679917', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31007'] for router, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:47.923499 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp504a2b3f-d829-5993-bcb8-b637faa01ef0-d07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514'}]}} from dv-cinder-791281-3-iscsi. {{(pid=92696) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 28 14:35:47.927531 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:47.927710 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:48.088356 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.db_base_plugin_common [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Allocated IP 172.20.0.2 (d07aad82-58f0-48c7-bdbc-4ebfe5f698dc/097b2b8c-d0d5-4b10-a710-a27ac2380514/c04dbd92-2a83-4e74-ba1b-b2de1b03c304) {{(pid=92696) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:35:48.273414 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-682021', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-685805', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31081'] for router, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:48.291373 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Notify callbacks [] for port, precommit_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:48.302187 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Transition to ACTIVE for port object c04dbd92-2a83-4e74-ba1b-b2de1b03c304 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:35:48.320488 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Transition to ACTIVE for port object c04dbd92-2a83-4e74-ba1b-b2de1b03c304 will not be triggered until provisioned by entity DHCP. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:35:48.392540 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971'] for port, after_create {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:48.397130 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:48.460366 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc is already hosted by enough agents. {{(pid=92696) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:35:48.463309 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.scheduler.base_scheduler [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Resources bound (agent type, host, resource id):  {{(pid=92696) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:35:48.465965 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Received port after_create {{(pid=92696) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:35:48.504802 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Pushing event updated for resources: {'Port': ['ID=c04dbd92-2a83-4e74-ba1b-b2de1b03c304,revision_number=1']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:48.507886 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:48.563387 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Attempting to bind port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:35:48.563773 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Attempting to bind port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:35:48.564137 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Attempting to bind port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 on network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:35:48.569541 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 35, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:35:48.570006 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Checking segment: {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:35:48.570411 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:48.570803 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Bound using segment: {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:35:48.571263 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Bound port: c04dbd92-2a83-4e74-ba1b-b2de1b03c304, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:35:48.571665 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:48.657295 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] For port c04dbd92-2a83-4e74-ba1b-b2de1b03c304, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:35:48.660210 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] For port c04dbd92-2a83-4e74-ba1b-b2de1b03c304, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=c04dbd92-2a83-4e74-ba1b-b2de1b03c304,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:35:48.662357 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:48.694892 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:48.754018 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:48.758801 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:48.831094 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Allocated IP 172.27.3.180 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/ceb644dd-c4ef-4e1b-80fe-6e4a47970da2) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:35:48.853435 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Pushing event updated for resources: {'Port': ['ID=c04dbd92-2a83-4e74-ba1b-b2de1b03c304,revision_number=2']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:48.857300 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-70877354-2b16-4e71-8592-b1eefd9732f2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:48.988785 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:49.108254 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:49.112445 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:49.179905 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:35:49.182912 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:35:49.187454 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:35:49.231255 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Pushing event updated for resources: {'Port': ['ID=ceb644dd-c4ef-4e1b-80fe-6e4a47970da2,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:49.236293 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:49.292332 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device c04dbd92-2a83-4e74-ba1b-b2de1b03c304 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:35:49.410781 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:35:49.772646 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d96a35a2-723b-466b-bb1f-f7c09e151a8d None None] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:35:49.783208 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:49.936081 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a09f9f3e-6401-4301-9459-710adb6800ed None None] Provisioning for port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:35:49.944231 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a09f9f3e-6401-4301-9459-710adb6800ed None None] Provisioning complete for port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:35:49.944593 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a09f9f3e-6401-4301-9459-710adb6800ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:50.125938 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-685782', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-682086'] for router, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:50.155381 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a09f9f3e-6401-4301-9459-710adb6800ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:50.189330 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-a09f9f3e-6401-4301-9459-710adb6800ed None None] For port c04dbd92-2a83-4e74-ba1b-b2de1b03c304, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=c04dbd92-2a83-4e74-ba1b-b2de1b03c304,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:35:50.262385 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a09f9f3e-6401-4301-9459-710adb6800ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:50.264338 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:50.332009 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a09f9f3e-6401-4301-9459-710adb6800ed None None] Pushing event updated for resources: {'Port': ['ID=c04dbd92-2a83-4e74-ba1b-b2de1b03c304,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:50.335243 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-a09f9f3e-6401-4301-9459-710adb6800ed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:50.383180 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-008aa48c-293e-4cea-a8a6-7c02b3640043 None None] Provisioning complete for port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:35:50.383494 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-008aa48c-293e-4cea-a8a6-7c02b3640043 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:50.437667 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Router 70a9e813-5550-4032-8b40-07e33a0a7066 is scheduled to L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 with binding_index 1 {{(pid=92694) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 28 14:35:50.619575 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:35:50.629759 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Sync routers for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:35:50.638730 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:35:50.639269 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2531bb0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:35:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:50.719114 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Notify callbacks [] for router, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:50.720407 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] 10.222.0.59 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 2.9109428
May 28 14:35:50.723078 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40468) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:50.811839 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:35:51.097290 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2531bb0>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:49Z', 'revision_number': 3, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:51.101332 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Checking router: 70a9e813-5550-4032-8b40-07e33a0a7066 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:35:51.101681 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Updating router 70a9e813-5550-4032-8b40-07e33a0a7066 port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 binding host dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:35:51.154923 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:51.247652 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device c04dbd92-2a83-4e74-ba1b-b2de1b03c304 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:35:51.315771 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:35:51.316147 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:51.493262 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Notify callbacks [] for port, precommit_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:51.506040 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.provisioning_blocks [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Transition to ACTIVE for port object ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 will not be triggered until provisioned by entity L2. {{(pid=92697) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:35:51.531888 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:51.587246 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:51.592289 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:51.671227 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Attempting to bind port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:35:51.671946 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Attempting to bind port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:35:51.672094 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Attempting to bind port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 on network f203e1e9-7403-4723-8925-7d733bca2c40 {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:35:51.680696 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Pushing event updated for resources: {'Port': ['ID=ceb644dd-c4ef-4e1b-80fe-6e4a47970da2,revision_number=2']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:51.684896 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 35, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:35:51.685271 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Checking segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92697) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:35:51.685675 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:51.686067 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Bound using segment: {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'} {{(pid=92697) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:35:51.686548 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.managers [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Bound port: ceb644dd-c4ef-4e1b-80fe-6e4a47970da2, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05effb8c-4f51-4169-bfda-7593cb4b5695', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}}] {{(pid=92697) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:35:51.686922 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:51.723676 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.724025 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.724360 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.724695 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.725016 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.725338 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.725655 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.725973 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.726310 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.726628 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.726946 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.727258 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92697) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:35:51.731400 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:51.743173 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Allocated IP 172.20.0.1 (d07aad82-58f0-48c7-bdbc-4ebfe5f698dc/097b2b8c-d0d5-4b10-a710-a27ac2380514/6a43bb26-ad55-4dab-aca2-7b62cc6955c6) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:35:51.769968 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] For port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92697) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:35:51.772984 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.plugins.ml2.db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] For port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=ceb644dd-c4ef-4e1b-80fe-6e4a47970da2,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92697) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:35:51.855225 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron_lib.callbacks.manager [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92697) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:51.859851 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-1b98801d-539d-45bd-bdfd-f30c4102e62f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:51.893588 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:51.909497 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.provisioning_blocks [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Transition to ACTIVE for port object 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 will not be triggered until provisioned by entity DHCP. {{(pid=92694) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:35:51.934031 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:35:51.934633 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2531bb0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:35:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:51.997161 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Pushing event updated for resources: {'Port': ['ID=ceb644dd-c4ef-4e1b-80fe-6e4a47970da2,revision_number=3']} {{(pid=92697) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:52.000115 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG oslo_concurrency.lockutils [None req-3eebe1db-a56a-4982-bf9d-117dfb0cfe19 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:52.011695 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:52.016579 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:52.077508 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:35:52.080462 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:35:52.084268 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:35:52.117051 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:35:52.125902 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Pushing event updated for resources: {'Port': ['ID=6a43bb26-ad55-4dab-aca2-7b62cc6955c6,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:52.136706 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:52.148284 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-681751'] for router_interface, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:52.381753 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-f715903a-751d-4849-955a-c0c790008ab4 None None] Provisioning for port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:35:52.387449 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-f715903a-751d-4849-955a-c0c790008ab4 None None] Provisioning complete for port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:35:52.391199 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f715903a-751d-4849-955a-c0c790008ab4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:52.428072 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2531bb0>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:49Z', 'revision_number': 3, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:52.432077 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-235c49da-9607-4458-aaa3-8321c8432b00 None None] The sync data for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi is: [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:49Z', 'revision_number': 3, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:35:52.447650 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-f715903a-751d-4849-955a-c0c790008ab4 None None] Port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:35:52.469973 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:52.708600 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:52.770899 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:52.798712 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-b456e173-1b87-43bc-be41-ab7b61ccf4ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:52.877545 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-681914'] for router_interface, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:52.881244 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Pushing event updated for resources: {'Port': ['ID=6a43bb26-ad55-4dab-aca2-7b62cc6955c6,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:52.884621 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:53.131912 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:35:53.133051 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:35:53.274912 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:35:53.336317 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Router 70a9e813-5550-4032-8b40-07e33a0a7066 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:35:53.381037 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-b423cade-b7c4-4f6b-a149-1ca94f3373f7 None None] Provisioning complete for port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:35:53.381432 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b423cade-b7c4-4f6b-a149-1ca94f3373f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:53.437418 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-b423cade-b7c4-4f6b-a149-1ca94f3373f7 None None] Port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:35:53.444265 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:35:53.449173 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:35:53.451586 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:53.528232 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:35:53.537981 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] 10.222.0.59 "PUT /v2.0/routers/70a9e813-5550-4032-8b40-07e33a0a7066/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8139105
May 28 14:35:53.568794 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:53.585574 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=ceb644dd-c4ef-4e1b-80fe-6e4a47970da2,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:35:53.661921 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:53.664470 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-175710a2-e19d-4c39-a10a-a9163028f412 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:53.738917 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=ceb644dd-c4ef-4e1b-80fe-6e4a47970da2,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:53.742114 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:53.955331 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Sync routers for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:35:53.964681 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:35:53.965358 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba24b6880>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:35:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:54.140961 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:35:54.265221 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40480) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:54.270652 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'security_group': {'name': 'tempest-securitygroup--986428465', 'description': 'tempest-description--1603640315'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:35:54.276715 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:35:54.280477 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:security_group and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:35:54.283403 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:35:54.289460 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:35:54.410560 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:54.431692 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:35:54.436094 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:security_group_rule and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:35:54.438912 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:35:54.444755 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:35:54.452483 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba24b6880>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 2, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:54.456399 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Checking router: 70a9e813-5550-4032-8b40-07e33a0a7066 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:35:54.456784 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Updating router 70a9e813-5550-4032-8b40-07e33a0a7066 port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 binding host dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 28 14:35:54.511080 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:54.519991 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:54.593349 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:54.597249 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-64b4b4a5-5694-486e-a80c-6da867823f21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:54.638647 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'SecurityGroup': ['ID=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:54.641556 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:54.725730 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:54.726998 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-23fd24ae-1f73-46b3-bae2-b53f147584ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4607949
May 28 14:35:54.730473 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40484) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:54.735785 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'security_group_rule': {'security_group_id': '39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:35:54.741999 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:35:54.746174 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:security_group_rule and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:35:54.749111 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:35:54.754909 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:35:54.831916 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:54.889979 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Notify callbacks [] for port, precommit_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:54.893773 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:54.901856 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Transition to ACTIVE for port object 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 will not be triggered until provisioned by entity L2. {{(pid=92696) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:35:54.993751 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:54.996382 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:55.019236 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=306ccce2-abd6-4344-a2c1-d86d5b18290c,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:55.020917 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.024713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:55.028730 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-b3a29ad4-8f16-41e7-ac86-483ae6de5425 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:55.123501 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.125035 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-88a11033-7b7e-43e1-a743-ecdd4facffa1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3936062
May 28 14:35:55.127828 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40488) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:55.133203 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'security_group_rule': {'security_group_id': '39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:35:55.140258 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:35:55.145026 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:security_group_rule and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:35:55.150501 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:35:55.154417 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:35:55.184518 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91746860-672a-4654-88f2-e50e3ee25613 None None] Pushing event updated for resources: {'Port': ['ID=6a43bb26-ad55-4dab-aca2-7b62cc6955c6,revision_number=3']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:55.187058 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-91746860-672a-4654-88f2-e50e3ee25613 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:55.232975 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.251970 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Attempting to bind port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 on host dv-cinder-791281-3-iscsi for vnic_type normal with profile  {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:35:55.252471 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Attempting to bind port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 by drivers openvswitch,hyperv on host dv-cinder-791281-3-iscsi at level 0 using segments [{'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:35:55.252886 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Attempting to bind port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 on network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:35:55.256612 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:35:55.294115 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Checking agent: {'id': 'f88c762f-bf55-4a3e-a278-f3d152d9691a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791281-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 13, 2), 'started_at': datetime.datetime(2021, 5, 28, 14, 13, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 35, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791281-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:35:55.294489 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Checking segment: {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92696) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:35:55.299457 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.299457 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Bound using segment: {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'} {{(pid=92696) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:35:55.299457 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.managers [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Bound port: 6a43bb26-ad55-4dab-aca2-7b62cc6955c6, host: dv-cinder-791281-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'}}] {{(pid=92696) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:35:55.299457 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.305419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.387989 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.403394 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0b0e1f1f-b97b-4787-a2fc-c36d27b32b51 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:55.418114 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:35:55.418584 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.421400 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6016f5f6-da01-4037-b017-dff4fc22ad18,revision_number=0']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:55.423907 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:55.467322 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] For port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6, host dv-cinder-791281-3-iscsi, cleared binding levels {{(pid=92696) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:35:55.477364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.478655 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-7afd1c96-793b-47bc-8ed6-fdeb31e33ff4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3498828
May 28 14:35:55.481023 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] For port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6, host dv-cinder-791281-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=6a43bb26-ad55-4dab-aca2-7b62cc6955c6,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:35:55.481782 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40492) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:35:55.487076 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'floatingip': {'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:35:55.492972 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:35:55.497658 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:floatingip and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:35:55.500708 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:35:55.506640 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:35:55.570618 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.574771 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:55.597808 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.652076 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:35:55.652525 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba24b6880>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:35:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:55.707547 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91746860-672a-4654-88f2-e50e3ee25613 None None] Pushing event updated for resources: {'Port': ['ID=6a43bb26-ad55-4dab-aca2-7b62cc6955c6,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:55.717875 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-91746860-672a-4654-88f2-e50e3ee25613 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:55.754605 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:55.861514 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:35:55.906420 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Allocated IP 172.27.3.105 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/503f4aaf-a37f-4169-856a-e1dd7b3d6787) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:35:56.055821 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:56.136570 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:56.140404 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8f95af48-7c28-4ded-bf18-847f5b9b80ec service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:56.179628 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba24b6880>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:55Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:35:56.183690 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dc43ab0-9bf6-47b5-a2e0-d30696bd0e69 None None] The sync data for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi is: [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:55Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:35:56.208078 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:35:56.210917 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:35:56.213347 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:35:56.256546 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'Port': ['ID=503f4aaf-a37f-4169-856a-e1dd7b3d6787,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:56.259421 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:56.317782 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:56.458434 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:56.676750 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:56.741636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:56.747042 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-2443e2f7-8e5c-4b68-bf55-b7c47678f055 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:56.857109 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'Port': ['ID=503f4aaf-a37f-4169-856a-e1dd7b3d6787,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:56.861369 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:56.868402 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:56.958848 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:56.960118 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.4773955
May 28 14:35:57.133759 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-f51a067d-feb3-49af-a354-f1f0bc9b3b9f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-securitygroup--986428465&fields=id&tenant_id=61d5abfd60c747b5ad4bdeb820132545 HTTP/1.1" status: 200  len: 267 time: 0.0412037
May 28 14:35:57.269980 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:35:57.289510 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8110438d-d25e-44c9-85d7-4a01721e396c req-aaa04501-290b-41e7-a376-a33fc12bc2c2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:35:57.290939 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-aaa04501-290b-41e7-a376-a33fc12bc2c2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 809 time: 0.1502559
May 28 14:35:57.305999 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-584aeef0-a9f0-4d85-bb4d-fab40285d24e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/quotas/61d5abfd60c747b5ad4bdeb820132545 HTTP/1.1" status: 200  len: 375 time: 0.0089948
May 28 14:35:57.392458 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-8110438d-d25e-44c9-85d7-4a01721e396c req-c8e1c85e-9e07-4016-9efa-f6c170be394c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Synchronizing usage tracker for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:35:57.438834 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning for port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:35:57.443913 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:35:57.444315 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:57.479087 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-8110438d-d25e-44c9-85d7-4a01721e396c req-c8e1c85e-9e07-4016-9efa-f6c170be394c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Unset dirty status for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:35:57.481014 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-c8e1c85e-9e07-4016-9efa-f6c170be394c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1669269
May 28 14:35:57.565290 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:57.596902 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=6a43bb26-ad55-4dab-aca2-7b62cc6955c6,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:35:57.623953 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-3a2342dc-42df-4ee5-a3f6-a016113100f9 service neutron] 10.222.0.59 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1314290
May 28 14:35:57.644802 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:57.646949 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:35:57.752903 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=6a43bb26-ad55-4dab-aca2-7b62cc6955c6,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:35:57.755897 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:35:57.759820 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-a2683d3c-1b03-45f7-bf5c-29f20fc7266d service neutron] 10.222.0.59 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1301236
May 28 14:35:57.947653 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:35:58.014817 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a52b9b4d-c588-4c7b-9e02-fdb7b2230541 req-f2545e7c-56af-4556-b6ee-940a258e21c5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 210 time: 0.0449531
May 28 14:35:59.189108 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9b2c00cb-f716-4ac6-9d56-47f303398dd7 req-7b097d54-81ab-4daa-965c-a80219ac7e20 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 210 time: 0.0500517
May 28 14:35:59.249275 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 up at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:35:59.316743 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Provisioning complete for port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:35:59.317120 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:00.020053 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-10168d31-a350-451c-9fbc-5bb632928df4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:00.495649 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-0702c77d-fdde-4af4-ac05-ba25166bdf38 req-7accd20c-364a-4e73-a4c8-d4d437d2fb22 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 210 time: 0.1679854
May 28 14:36:00.563834 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5dbd79df-e7de-4eb7-82b5-b1658a0f9b29 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:00.563834 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5dbd79df-e7de-4eb7-82b5-b1658a0f9b29 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Synchronizing usage tracker for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:network {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:36:00.661398 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5dbd79df-e7de-4eb7-82b5-b1658a0f9b29 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Unset dirty status for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:network {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:36:00.662574 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5dbd79df-e7de-4eb7-82b5-b1658a0f9b29 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 809 time: 0.4136839
May 28 14:36:00.712887 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5a06892d-a54b-4eaa-8ea7-302c3838e625 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Synchronizing usage tracker for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:security_group {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:36:00.799083 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5a06892d-a54b-4eaa-8ea7-302c3838e625 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Unset dirty status for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:security_group {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:36:00.801410 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5a06892d-a54b-4eaa-8ea7-302c3838e625 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=61d5abfd60c747b5ad4bdeb820132545 HTTP/1.1" status: 200  len: 379 time: 0.1292503
May 28 14:36:00.823280 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'port': {'device_id': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'admin_state_up': True, 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'security_groups': ['39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14']}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:36:00.968994 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:36:00.978851 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:36:01.021748 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Made reservation on behalf of 61d5abfd60c747b5ad4bdeb820132545 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:36:01.025306 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:01.196248 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Allocated IP 172.20.0.12 (d07aad82-58f0-48c7-bdbc-4ebfe5f698dc/097b2b8c-d0d5-4b10-a710-a27ac2380514/c41d8419-2408-4487-95f1-5b6ce2ba8dab) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:36:01.401945 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:01.418731 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Transition to ACTIVE for port object c41d8419-2408-4487-95f1-5b6ce2ba8dab will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:36:01.513817 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:01.520330 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-cf9def87-55f3-4d8e-8182-919e6c234b12 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:01.591916 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:36:01.595117 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:36:01.599170 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:36:01.641872 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'Port': ['ID=c41d8419-2408-4487-95f1-5b6ce2ba8dab,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:01.650489 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:01.679022 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:01.679719 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:01.717596 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b09d06-f546-4606-b7cd-147405aef7da req-e4efb9e8-aedc-4083-9872-d1085035c3f4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:01.722408 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d0b09d06-f546-4606-b7cd-147405aef7da req-e4efb9e8-aedc-4083-9872-d1085035c3f4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 932 time: 0.0987206
May 28 14:36:01.785317 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d0b09d06-f546-4606-b7cd-147405aef7da req-07c175eb-fc05-4331-b981-b1ad857880c0 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0596964
May 28 14:36:01.788018 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-5d5e67e7-5617-44d6-961f-6b8503d90c99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9695017
May 28 14:36:01.804066 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Request body: {'port': {'device_id': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:36:01.912841 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a7afef7a-ed11-4c20-88c9-ca2b139f0a75 None None] Provisioning for port c41d8419-2408-4487-95f1-5b6ce2ba8dab completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:36:01.918053 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-a7afef7a-ed11-4c20-88c9-ca2b139f0a75 None None] Provisioning complete for port c41d8419-2408-4487-95f1-5b6ce2ba8dab triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:36:01.918420 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a7afef7a-ed11-4c20-88c9-ca2b139f0a75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:01.924188 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:01.977022 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-a7afef7a-ed11-4c20-88c9-ca2b139f0a75 None None] Port c41d8419-2408-4487-95f1-5b6ce2ba8dab cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:36:02.282377 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c41d8419-2408-4487-95f1-5b6ce2ba8dab {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:36:02.289793 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:02.303702 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Transition to ACTIVE for port object c41d8419-2408-4487-95f1-5b6ce2ba8dab will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:36:02.500363 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:02.505124 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-83417bca-9852-4d80-a5ca-844d013b328d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:02.563646 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:02.592948 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3c98d8d9-7274-44df-9df4-810cd16d1f97 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:02.660169 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Pushing event updated for resources: {'Port': ['ID=c41d8419-2408-4487-95f1-5b6ce2ba8dab,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:02.667937 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:02.740132 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Attempting to bind port c41d8419-2408-4487-95f1-5b6ce2ba8dab on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:36:02.740458 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Attempting to bind port c41d8419-2408-4487-95f1-5b6ce2ba8dab by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:36:02.740781 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Attempting to bind port c41d8419-2408-4487-95f1-5b6ce2ba8dab on network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:36:02.746295 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Port c41d8419-2408-4487-95f1-5b6ce2ba8dab on network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:36:02.746606 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Attempting to bind port c41d8419-2408-4487-95f1-5b6ce2ba8dab on network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:36:02.751571 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 35, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:36:02.751908 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Checking segment: {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:36:02.752280 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Bound using segment: {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:36:02.752696 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Bound port: c41d8419-2408-4487-95f1-5b6ce2ba8dab, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:36:02.753030 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:02.840779 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] For port c41d8419-2408-4487-95f1-5b6ce2ba8dab, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:36:02.843981 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] For port c41d8419-2408-4487-95f1-5b6ce2ba8dab, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:36:02.957030 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:02.962277 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-10430a92-50f1-4e38-afba-67391de2914a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:03.011883 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:03.012692 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:03.014203 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] 10.222.0.90 "PUT /v2.0/ports/c41d8419-2408-4487-95f1-5b6ce2ba8dab HTTP/1.1" status: 200  len: 1094 time: 1.2183447
May 28 14:36:03.023109 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'tag': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:36:03.058982 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Pushing event updated for resources: {'Port': ['ID=c41d8419-2408-4487-95f1-5b6ce2ba8dab,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:03.064824 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:03.077912 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f01505-c9d7-4f99-8649-ee57ef463c89 req-3c4268e6-9a1e-4f31-8a9a-f6f401252f08 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:03.078666 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-67f01505-c9d7-4f99-8649-ee57ef463c89 req-3c4268e6-9a1e-4f31-8a9a-f6f401252f08 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Synchronizing usage tracker for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:36:03.082320 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'tag': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab', 'status': 'completed', 'code': 200}
May 28 14:36:03.259379 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-67f01505-c9d7-4f99-8649-ee57ef463c89 req-3c4268e6-9a1e-4f31-8a9a-f6f401252f08 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Unset dirty status for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:36:03.261060 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-67f01505-c9d7-4f99-8649-ee57ef463c89 req-3c4268e6-9a1e-4f31-8a9a-f6f401252f08 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 944 time: 0.3605683
May 28 14:36:03.319484 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-67f01505-c9d7-4f99-8649-ee57ef463c89 req-5ca73ecc-b82f-41c5-a42c-5c9c89fd7296 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497818
May 28 14:36:03.327364 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-44e59200-b788-4993-a614-b4d7b3b28003 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:03.328818 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-44e59200-b788-4993-a614-b4d7b3b28003 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 1097 time: 0.2213092
May 28 14:36:03.483093 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-2840d145-417d-4073-9509-525e64f23cba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:03.484485 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-2840d145-417d-4073-9509-525e64f23cba service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=61d5abfd60c747b5ad4bdeb820132545&shared=False HTTP/1.1" status: 200  len: 910 time: 0.1464756
May 28 14:36:03.622746 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-8a30ca27-fd80-4649-b60f-b816d4a5c596 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:03.624219 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-38e4ae4d-2921-4142-9eef-df987fd91072 req-8a30ca27-fd80-4649-b60f-b816d4a5c596 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1316631
May 28 14:36:03.718569 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:03.744178 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8110438d-d25e-44c9-85d7-4a01721e396c req-6f7a425b-1ab9-492a-80e7-e6776aa3154e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:03.746101 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-6f7a425b-1ab9-492a-80e7-e6776aa3154e service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 1097 time: 0.0848870
May 28 14:36:03.821712 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-05353981-7cc5-4efd-abb1-70d8641835a4 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab HTTP/1.1" status: 200  len: 217 time: 0.0681641
May 28 14:36:03.884569 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8110438d-d25e-44c9-85d7-4a01721e396c req-3a7397d2-73cf-41ee-9d71-66338f01af0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:03.886595 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-3a7397d2-73cf-41ee-9d71-66338f01af0b service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0575304
May 28 14:36:03.965700 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8110438d-d25e-44c9-85d7-4a01721e396c req-357e16af-6a3d-428b-a64e-f2879900b135 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:03.967155 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-357e16af-6a3d-428b-a64e-f2879900b135 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0725927
May 28 14:36:04.105133 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-008fa049-0eb8-4feb-99df-91e6920ca677 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1246541
May 28 14:36:04.234433 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8110438d-d25e-44c9-85d7-4a01721e396c req-1a2af243-a884-4d85-afc6-e615d7b3e124 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1229012
May 28 14:36:04.508750 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4a541f-a869-4e65-bca7-2779fc62846c req-9cabbf8f-c662-4391-b07a-5fa1e92c1cf5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:04.510336 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9c4a541f-a869-4e65-bca7-2779fc62846c req-9cabbf8f-c662-4391-b07a-5fa1e92c1cf5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 944 time: 0.0838006
May 28 14:36:04.556472 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9c4a541f-a869-4e65-bca7-2779fc62846c req-d8fa2bb2-2817-4ca1-803c-3c1975811922 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404606
May 28 14:36:05.358364 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:05.893615 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 req-0760e41b-93c8-4693-b52e-591ee58c5ca8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:05.894970 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 req-0760e41b-93c8-4693-b52e-591ee58c5ca8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 944 time: 0.0867817
May 28 14:36:05.939354 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ffd3cd7b-12d0-4880-a2b2-09904fd3c974 req-3b301671-37f8-4748-9462-64e1ac35ae96 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385840
May 28 14:36:07.123796 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 req-08566420-d4cf-40c4-8ca2-db9ea6d49bea tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:07.125162 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 req-08566420-d4cf-40c4-8ca2-db9ea6d49bea tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 944 time: 0.0801196
May 28 14:36:07.173077 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d1a6e790-f1ee-4d22-a0b9-90dcd70179a4 req-4c35cba3-4001-43bc-be0c-54494c784721 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421073
May 28 14:36:08.355325 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30efe93b-ab1c-4006-b94c-b059725734ce req-d0fca77e-a95c-43c5-ad3f-19ee3664a03e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:08.356782 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-30efe93b-ab1c-4006-b94c-b059725734ce req-d0fca77e-a95c-43c5-ad3f-19ee3664a03e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 944 time: 0.0827951
May 28 14:36:08.399665 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-30efe93b-ab1c-4006-b94c-b059725734ce req-b51fb713-c737-43f8-8e98-81921aca26f9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0373232
May 28 14:36:08.527201 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:36:08.668419 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c41d8419-2408-4487-95f1-5b6ce2ba8dab details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:36:08.799432 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c41d8419-2408-4487-95f1-5b6ce2ba8dab, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:08.816464 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'port_id': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab', 'mac_address': 'fa:16:3e:10:df:0c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 851, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:36:08.870176 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:08.886628 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c41d8419-2408-4487-95f1-5b6ce2ba8dab {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:36:08.903023 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c41d8419-2408-4487-95f1-5b6ce2ba8dab, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:08.964461 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:08.967034 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:09.033211 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c41d8419-2408-4487-95f1-5b6ce2ba8dab,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:09.036277 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:09.361246 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['c41d8419-2408-4487-95f1-5b6ce2ba8dab'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:36:09.589702 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac req-b079901c-440b-45d8-a370-9441f8879fd6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:09.591152 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac req-b079901c-440b-45d8-a370-9441f8879fd6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 945 time: 0.0831342
May 28 14:36:09.635681 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5149ba33-d0ea-4ad4-958d-6eaf68d65cac req-e5b1d577-bc44-42d3-9343-ddf425b375dd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387936
May 28 14:36:10.671649 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c41d8419-2408-4487-95f1-5b6ce2ba8dab up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:36:10.820164 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port c41d8419-2408-4487-95f1-5b6ce2ba8dab completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:36:10.824340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8796da-2abb-4323-ba2b-a9aff2716219 req-eeaf9a88-c152-4525-869c-473a993be839 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:10.829297 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port c41d8419-2408-4487-95f1-5b6ce2ba8dab triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:36:10.829440 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2c8796da-2abb-4323-ba2b-a9aff2716219 req-eeaf9a88-c152-4525-869c-473a993be839 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 945 time: 0.0810270
May 28 14:36:10.829559 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:10.874532 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2c8796da-2abb-4323-ba2b-a9aff2716219 req-527c7cf6-6a9e-4c37-b98e-15b82e4a79a2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0429294
May 28 14:36:10.951201 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:10.981053 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:36:10.990794 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port c41d8419-2408-4487-95f1-5b6ce2ba8dab, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:11.024297 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab', 'code': 200}
May 28 14:36:11.061051 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:11.062930 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:11.129694 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=c41d8419-2408-4487-95f1-5b6ce2ba8dab,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:11.132746 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:11.376340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f55a9-d0fd-4bfd-90f0-37aeb05b6850 req-f026bb80-830b-4e26-9fcc-bee6f733cbc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:11.377783 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bd3f55a9-d0fd-4bfd-90f0-37aeb05b6850 req-f026bb80-830b-4e26-9fcc-bee6f733cbc4 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 1099 time: 0.0712836
May 28 14:36:11.418921 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bd3f55a9-d0fd-4bfd-90f0-37aeb05b6850 req-5249fb81-88cb-4333-b490-a1e806e780a7 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0342925
May 28 14:36:12.059306 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-023d51a0-b714-4e00-b79d-d8aeff83cc5a req-726575f5-363f-4c5a-a4b9-492ff70a3e65 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:12.060773 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-023d51a0-b714-4e00-b79d-d8aeff83cc5a req-726575f5-363f-4c5a-a4b9-492ff70a3e65 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0832691
May 28 14:36:12.104886 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-023d51a0-b714-4e00-b79d-d8aeff83cc5a req-a0c2b17d-e971-48e6-b8bf-09475affe0dd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0384660
May 28 14:36:13.291030 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f3b06c1-218d-47c2-a2a4-18120db6b13f req-97ad87d2-3378-4c94-96e1-abd6abe35418 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:13.292497 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6f3b06c1-218d-47c2-a2a4-18120db6b13f req-97ad87d2-3378-4c94-96e1-abd6abe35418 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0834973
May 28 14:36:13.429687 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6f3b06c1-218d-47c2-a2a4-18120db6b13f req-9e52b228-8eb2-4e24-aec4-874eabbde0c3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1315732
May 28 14:36:13.605377 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3029af70-03a0-4c64-8b9b-e8a3aa442b38 req-6e762b21-37a4-4d45-867a-5fbf4677bede tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:13.606830 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3029af70-03a0-4c64-8b9b-e8a3aa442b38 req-6e762b21-37a4-4d45-867a-5fbf4677bede tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0774989
May 28 14:36:13.615955 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40560) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:13.621850 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [None req-6386d25a-cf47-43ef-a9ce-a9df7cd0f31d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'floatingip': {'port_id': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:36:13.700950 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6386d25a-cf47-43ef-a9ce-a9df7cd0f31d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:14.380548 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6386d25a-cf47-43ef-a9ce-a9df7cd0f31d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:14.454890 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6386d25a-cf47-43ef-a9ce-a9df7cd0f31d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:14.630166 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.l3_db [None req-6386d25a-cf47-43ef-a9ce-a9df7cd0f31d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Floating IP 9cfaadb4-78ab-49d7-8a47-671c0eeaac46 associated. External IP: 172.27.3.105, port: c41d8419-2408-4487-95f1-5b6ce2ba8dab.
May 28 14:36:14.982957 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6386d25a-cf47-43ef-a9ce-a9df7cd0f31d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Router 70a9e813-5550-4032-8b40-07e33a0a7066 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:36:15.273722 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6386d25a-cf47-43ef-a9ce-a9df7cd0f31d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:36:15.278479 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-6386d25a-cf47-43ef-a9ce-a9df7cd0f31d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:15.284148 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] Sync routers for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:36:15.294061 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:15.294767 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba26b15e0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:15.332653 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-6386d25a-cf47-43ef-a9ce-a9df7cd0f31d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "PUT /v2.0/floatingips/9cfaadb4-78ab-49d7-8a47-671c0eeaac46 HTTP/1.1" status: 200  len: 992 time: 1.7156665
May 28 14:36:15.333404 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'tag': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:36:15.380142 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'tag': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab', 'status': 'completed', 'code': 200}
May 28 14:36:15.477460 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-8161c223-adf6-4295-b880-9f4c397a0731 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:15.479464 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-8161c223-adf6-4295-b880-9f4c397a0731 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 1099 time: 0.0732932
May 28 14:36:15.480656 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:15.610297 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-b19b3753-4c6e-478f-b598-928c391b69b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:15.611875 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-b19b3753-4c6e-478f-b598-928c391b69b6 service neutron] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 910 time: 0.1263068
May 28 14:36:15.720101 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-7c9010e1-b167-4753-b454-76fd94b6cd31 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab HTTP/1.1" status: 200  len: 1000 time: 0.0995250
May 28 14:36:15.787532 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-ff8bf1d8-1dec-4dfd-b42e-b61cd7c796c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:15.788970 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-ff8bf1d8-1dec-4dfd-b42e-b61cd7c796c4 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0608931
May 28 14:36:15.839009 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba26b15e0>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '9cfaadb4-78ab-49d7-8a47-671c0eeaac46', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'floating_ip_address': '172.27.3.105', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'port_id': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'mac_address': 'fa:16:3e:10:df:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:35:56Z', 'updated_at': '2021-05-28T14:36:14Z', 'revision_number': 1, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:15.842803 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] Checking router: 70a9e813-5550-4032-8b40-07e33a0a7066 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:36:15.851033 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:15.851725 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba26b15e0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:15.871461 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-2c036327-f964-4862-a0cf-a2edda4f81dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:15.872970 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-2c036327-f964-4862-a0cf-a2edda4f81dc service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0774722
May 28 14:36:16.010882 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-3d19917d-e882-4c6e-8119-cfaf096a15f8 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1271155
May 28 14:36:16.030322 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:16.145664 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-107a6bc6-798e-41c1-aab2-e7ef3b7947c2 req-312800fa-26b8-4aaf-b60a-b2fa274ed974 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1277506
May 28 14:36:16.392723 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba26b15e0>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '9cfaadb4-78ab-49d7-8a47-671c0eeaac46', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'floating_ip_address': '172.27.3.105', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'port_id': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'mac_address': 'fa:16:3e:10:df:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:35:56Z', 'updated_at': '2021-05-28T14:36:14Z', 'revision_number': 1, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:16.396592 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f6130cd-1527-4ed5-b6c4-7a32dfd408cb None None] The sync data for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi is: [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': '9cfaadb4-78ab-49d7-8a47-671c0eeaac46', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'floating_ip_address': '172.27.3.105', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'port_id': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'mac_address': 'fa:16:3e:10:df:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:35:56Z', 'updated_at': '2021-05-28T14:36:14Z', 'revision_number': 1, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:36:16.575482 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e420c6b5-2552-465b-b7b5-16d619390848 None None] New status for floating IP 9cfaadb4-78ab-49d7-8a47-671c0eeaac46: ACTIVE {{(pid=92696) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:36:27.974808 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:30.007993 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-91424edc-ca40-43d8-8413-2cdf2d013ad8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:30.233605 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40594) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:30.643367 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Deleting port 4953c341-387b-4439-bdc5-e19ec4d55c34 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:30.643644 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:30.760613 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:30.765735 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:30.884755 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling delete_port for 4953c341-387b-4439-bdc5-e19ec4d55c34 owned by network:floatingip {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:31.060216 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:31.063872 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7f7eba7e-d276-4c88-8129-df98eae34b2b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:31.107418 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event deleted for resources: {'Port': ['ID=4953c341-387b-4439-bdc5-e19ec4d55c34,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:31.110644 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:31.201106 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:31.201435 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.l3_db [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Floating IP fb034c57-b244-41cf-a063-880bd81b3bcc disassociated (deleted). External IP: 172.27.3.236, port: 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78.
May 28 14:36:31.545338 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Router 0cb62432-a4fe-4ba8-9099-f616594e4211 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:36:31.833081 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:36:31.842603 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] Sync routers for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:36:31.852284 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:31.852888 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba25c1070>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:31.911646 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:31.967922 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-52829e33-2fd6-4524-91f2-69b3b694e86f tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "DELETE /v2.0/floatingips/fb034c57-b244-41cf-a063-880bd81b3bcc HTTP/1.1" status: 204  len: 168 time: 1.7308743
May 28 14:36:31.967922 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:36:32.014707 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'status': 'completed', 'code': 200}
May 28 14:36:32.035093 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:32.116232 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-39891924-7838-4482-add1-4c9dd21b53a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:32.118388 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-39891924-7838-4482-add1-4c9dd21b53a3 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 1099 time: 0.0790925
May 28 14:36:32.255214 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-c25a0c9a-3c83-480d-beca-0cf96e82afcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:32.256711 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-c25a0c9a-3c83-480d-beca-0cf96e82afcb service neutron] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 913 time: 0.1316559
May 28 14:36:32.326532 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-837ac3e9-62c6-4231-92b3-cf63de23efc9 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 HTTP/1.1" status: 200  len: 217 time: 0.0626853
May 28 14:36:32.396779 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-18702752-7ae3-4860-ab00-4aeaf216892e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:32.398162 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-18702752-7ae3-4860-ab00-4aeaf216892e service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.0634902
May 28 14:36:32.404369 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba25c1070>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'e141c6a5-bc74-487a-be63-addcf8e60750', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:49Z', 'updated_at': '2021-05-28T14:31:52Z', 'revision_number': 1, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:32.408744 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] Checking router: 0cb62432-a4fe-4ba8-9099-f616594e4211 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:36:32.418688 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:32.419301 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba25c1070>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:32.539748 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-8ea34079-bf2d-4f54-8b80-be327173cabd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:32.541212 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-8ea34079-bf2d-4f54-8b80-be327173cabd service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1348696
May 28 14:36:32.557723 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:32.571288 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c967c674-85b7-4edb-9d97-3d24283a4fa0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:32.614397 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:32.632853 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c req-fdd1ad63-6539-4213-8405-1d00550ad058 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:32.633607 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c req-fdd1ad63-6539-4213-8405-1d00550ad058 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:36:32.680355 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-3cd9fcc7-b18a-4eac-ae02-24d390e13645 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1303797
May 28 14:36:32.705989 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c req-fdd1ad63-6539-4213-8405-1d00550ad058 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:36:32.707306 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c req-fdd1ad63-6539-4213-8405-1d00550ad058 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 946 time: 0.2275112
May 28 14:36:32.757612 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2e97e89a-1ff0-47af-8c84-a7b35621ac7c req-91005918-03e5-4aeb-8d58-10ccd5107f39 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0446479
May 28 14:36:32.820722 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4cf4c268-d789-416c-9a27-bd8ab7bdf9a3 req-79f4e96d-3da5-4f11-b76a-d1b725fa7b98 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1340766
May 28 14:36:32.963386 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba25c1070>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'e141c6a5-bc74-487a-be63-addcf8e60750', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:49Z', 'updated_at': '2021-05-28T14:31:52Z', 'revision_number': 1, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:32.967220 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1fae2b70-26d6-4437-b77f-b4088a33e7a5 None None] The sync data for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi is: [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'e141c6a5-bc74-487a-be63-addcf8e60750', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'port_id': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'mac_address': 'fa:16:3e:bc:c2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:31:49Z', 'updated_at': '2021-05-28T14:31:52Z', 'revision_number': 1, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:36:33.176747 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-437ba03a-4f8c-4344-8e75-6079aff5cfb6 None None] New status for floating IP fb034c57-b244-41cf-a063-880bd81b3bcc: DOWN {{(pid=92696) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:36:33.739768 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:33.945005 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c req-c021c7c4-1754-41d4-80bb-bf99151c91a4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:33.946447 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c req-c021c7c4-1754-41d4-80bb-bf99151c91a4 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 946 time: 0.0807288
May 28 14:36:33.990698 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-2ac4848d-b9e5-4d9f-ac64-3343a4babb9c req-b98388fc-8336-40bf-9192-8012bf3f8b7a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0380628
May 28 14:36:34.574018 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10df532a-0c1b-4853-95d6-580dae395e61 req-0da29cbe-c4b3-49e6-bcff-ab35a67771fc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:34.575428 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-10df532a-0c1b-4853-95d6-580dae395e61 req-0da29cbe-c4b3-49e6-bcff-ab35a67771fc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 946 time: 0.0782385
May 28 14:36:34.711936 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-10df532a-0c1b-4853-95d6-580dae395e61 req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Deleting port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:34.712278 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-10df532a-0c1b-4853-95d6-580dae395e61 req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:34.944746 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-10df532a-0c1b-4853-95d6-580dae395e61 req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] For port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:34.945098 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-10df532a-0c1b-4853-95d6-580dae395e61 req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:35.070332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-10df532a-0c1b-4853-95d6-580dae395e61 req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling delete_port for 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:35.182360 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 req-c666dddf-332e-4ee3-8c71-0c70dd263575 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:35.183881 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 req-c666dddf-332e-4ee3-8c71-0c70dd263575 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 946 time: 0.0835643
May 28 14:36:35.227927 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-958bbb3a-3a0f-455f-946c-dc4bb019e5f8 req-fc0d0e90-f67b-42cc-a612-a88782e8ea01 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383518
May 28 14:36:35.254830 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-10df532a-0c1b-4853-95d6-580dae395e61 req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:35.261002 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f9fd1867-303c-4bd3-9bb6-db0401a2ee71 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:35.307603 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event deleted for resources: {'Port': ['ID=0c4d0a98-5c2e-401f-a013-9e7bf90a9c78,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:35.341950 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.347054 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:35.353950 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:35.380493 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:35.394701 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-10df532a-0c1b-4853-95d6-580dae395e61 req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] No DVR routers for this DVR port 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:36:35.397743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-10df532a-0c1b-4853-95d6-580dae395e61 req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:35.399783 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'name': 'network-vif-deleted', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:36:35.445663 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '53de36ab-8fe6-41ba-b6d2-785dadfa9989', 'name': 'network-vif-deleted', 'tag': '0c4d0a98-5c2e-401f-a013-9e7bf90a9c78', 'status': 'completed', 'code': 200}
May 28 14:36:35.449748 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-10df532a-0c1b-4853-95d6-580dae395e61 req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "DELETE /v2.0/ports/0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 HTTP/1.1" status: 204  len: 173 time: 0.8679483
May 28 14:36:36.443871 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 req-cd6229ed-dfce-47be-9831-3b45b2770c6d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:36:36.516362 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 req-cd6229ed-dfce-47be-9831-3b45b2770c6d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:36:36.517432 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a9923dc0-01c5-4b54-a5bf-908ab736cc99 req-cd6229ed-dfce-47be-9831-3b45b2770c6d tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=53de36ab-8fe6-41ba-b6d2-785dadfa9989 HTTP/1.1" status: 200  len: 210 time: 0.1664648
May 28 14:36:37.558163 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-230be116-14c9-4d1c-92fa-f6fb5fc8dd40 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0694208
May 28 14:36:37.647793 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-e859f66c-a344-4291-8339-8a4d46060c01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:37.649269 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-e859f66c-a344-4291-8339-8a4d46060c01 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1099 time: 0.0702636
May 28 14:36:37.794344 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-c7f383f9-5c63-47bc-ac58-a6c0fabd7569 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:37.795861 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-c7f383f9-5c63-47bc-ac58-a6c0fabd7569 service neutron] 10.222.0.90 "GET /v2.0/networks?id=cf0db8bd-5a73-44bf-9367-58867c9e819f HTTP/1.1" status: 200  len: 907 time: 0.1271574
May 28 14:36:37.904774 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-d1045f18-9233-4651-a59a-3d400d60b2f3 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5 HTTP/1.1" status: 200  len: 1002 time: 0.1021278
May 28 14:36:37.972540 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-4d24ca24-18f4-436f-8f28-d0e0f605f4b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:37.973964 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-4d24ca24-18f4-436f-8f28-d0e0f605f4b1 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4a437a5e-a3c1-4c29-a8be-fade6c84b5f4 HTTP/1.1" status: 200  len: 845 time: 0.0619211
May 28 14:36:38.047801 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-0695a7c1-8abf-4218-b16f-b72f29f8e81b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:38.049212 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-0695a7c1-8abf-4218-b16f-b72f29f8e81b service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf0db8bd-5a73-44bf-9367-58867c9e819f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0686190
May 28 14:36:38.185979 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-3c77a5bb-241e-4999-9304-27d8b1f806e8 service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1284614
May 28 14:36:38.318126 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8d800d7e-7c31-4c5f-807c-35c236ba7c8f req-720dfcb8-cb1f-4705-9a45-3bd0202fe981 service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1251059
May 28 14:36:38.797036 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:36:38.831162 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:36:38.831515 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 0c4d0a98-5c2e-401f-a013-9e7bf90a9c78 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:36:40.247709 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40652) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:40.512163 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Deleting port 148b4d30-ef9d-407b-a57d-6793093ad35c {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:40.512496 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:40.632634 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:40.632960 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:40.754666 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling delete_port for 148b4d30-ef9d-407b-a57d-6793093ad35c owned by network:floatingip {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:40.945973 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:40.950253 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:40.995517 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event deleted for resources: {'Port': ['ID=148b4d30-ef9d-407b-a57d-6793093ad35c,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:40.999237 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:41.087664 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:41.087936 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.l3_db [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Floating IP e141c6a5-bc74-487a-be63-addcf8e60750 disassociated (deleted). External IP: 172.27.3.50, port: a1d19f37-64ae-4f18-a8f2-79559df44a3b.
May 28 14:36:41.551007 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Router 0cb62432-a4fe-4ba8-9099-f616594e4211 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:36:41.732396 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:36:41.742747 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] Sync routers for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:36:41.752889 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:41.753484 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba24b2070>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:41.790742 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:41.851604 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "DELETE /v2.0/floatingips/e141c6a5-bc74-487a-be63-addcf8e60750 HTTP/1.1" status: 204  len: 168 time: 1.6027915
May 28 14:36:41.852271 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:36:41.899331 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'status': 'completed', 'code': 200}
May 28 14:36:41.935007 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:41.997078 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-747febb2-7bba-43dc-8b58-f7f23516539a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:41.999344 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-747febb2-7bba-43dc-8b58-f7f23516539a service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=c6d2d25991f04f00a48394ddbeec688e&device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 1098 time: 0.0745187
May 28 14:36:42.132742 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-52dacfd2-0bb6-4d6c-b6ea-24a500bb697b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:42.134064 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-52dacfd2-0bb6-4d6c-b6ea-24a500bb697b service neutron] 10.222.0.90 "GET /v2.0/networks?id=89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 200  len: 913 time: 0.1279070
May 28 14:36:42.289028 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba24b2070>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:42.293179 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] Checking router: 0cb62432-a4fe-4ba8-9099-f616594e4211 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:36:42.304202 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:42.304202 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba24b2070>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:42.307160 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-2a53772c-7824-42bc-a940-68f9fe6ec4ea service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b HTTP/1.1" status: 200  len: 217 time: 0.1659391
May 28 14:36:42.427310 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-845d053c-8934-4c91-8057-c2df41e80938 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:42.428656 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-845d053c-8934-4c91-8057-c2df41e80938 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 200  len: 851 time: 0.1139290
May 28 14:36:42.486366 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:42.506095 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 req-b581ba91-b202-4944-beb4-548455bde9f3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:42.507538 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 req-b581ba91-b202-4944-beb4-548455bde9f3 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.1479440
May 28 14:36:42.563504 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-1cd256be-3f4b-402b-8186-aa748824fff9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:42.564993 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-1cd256be-3f4b-402b-8186-aa748824fff9 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89b0ce92-0695-466c-b1ce-9a354ecba633&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1278493
May 28 14:36:42.569513 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1c1ac8ba-1b12-41f2-854a-def5e883cb61 req-7b170e88-a24d-40fd-97f4-86f269580241 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0536563
May 28 14:36:42.701721 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-89d9c23b-712b-4471-bb89-7a28922489f5 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1290729
May 28 14:36:42.799227 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba24b2070>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:42.803041 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67dc6687-784e-44b2-9a09-39132ed537b8 None None] The sync data for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi is: [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:25:16Z', 'revision_number': 4, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'dbcc346c-8a01-43e6-927e-2d168febed7c', 'name': '', 'network_id': '89b0ce92-0695-466c-b1ce-9a354ecba633', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'mac_address': 'fa:16:3e:41:5f:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_interface', 'standard_attr_id': 429, 'fixed_ips': [{'subnet_id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:15Z', 'updated_at': '2021-05-28T14:25:23Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'subnets': [{'id': 'a63662e1-f44d-44cd-98c9-2b87dba66278', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:36:42.838152 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-193669d7-fd57-4ee2-a548-e35d2e0fe855 req-a54df7da-e902-474c-a67b-17fe97772978 service neutron] 10.222.0.90 "GET /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1273084
May 28 14:36:43.027190 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-772506ac-afcf-471e-9559-630fc0ef2dd8 None None] New status for floating IP e141c6a5-bc74-487a-be63-addcf8e60750: DOWN {{(pid=92696) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:36:43.298494 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eee4d84-175c-421b-b3ad-514582db4550 req-e83171d0-4abd-43ff-89cb-4c5013329d4a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:43.299939 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9eee4d84-175c-421b-b3ad-514582db4550 req-e83171d0-4abd-43ff-89cb-4c5013329d4a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.0780439
May 28 14:36:43.437353 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-9eee4d84-175c-421b-b3ad-514582db4550 req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Deleting port a1d19f37-64ae-4f18-a8f2-79559df44a3b {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:43.437693 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-9eee4d84-175c-421b-b3ad-514582db4550 req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:43.571395 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-9eee4d84-175c-421b-b3ad-514582db4550 req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] For port a1d19f37-64ae-4f18-a8f2-79559df44a3b, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=a1d19f37-64ae-4f18-a8f2-79559df44a3b,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:43.571781 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-9eee4d84-175c-421b-b3ad-514582db4550 req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:43.694773 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-9eee4d84-175c-421b-b3ad-514582db4550 req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling delete_port for a1d19f37-64ae-4f18-a8f2-79559df44a3b owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:43.795841 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d1a728-fa2b-4902-be9a-6e0cccced08f req-75b37f56-724d-4dbf-80ca-beeb3b2c67d0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:43.797115 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7d1a728-fa2b-4902-be9a-6e0cccced08f req-75b37f56-724d-4dbf-80ca-beeb3b2c67d0 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 945 time: 0.1095724
May 28 14:36:43.880602 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e7d1a728-fa2b-4902-be9a-6e0cccced08f req-4a906111-9738-4d4c-a9df-0ee96e043c95 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/security-groups?id=fe9fa133-b1e0-4e56-971e-af9cdb27b031&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0763435
May 28 14:36:43.968433 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-9eee4d84-175c-421b-b3ad-514582db4550 req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:43.973961 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:44.018354 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event deleted for resources: {'Port': ['ID=a1d19f37-64ae-4f18-a8f2-79559df44a3b,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:44.021474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:44.093352 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-9eee4d84-175c-421b-b3ad-514582db4550 req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] No DVR routers for this DVR port a1d19f37-64ae-4f18-a8f2-79559df44a3b on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:36:44.095714 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-9eee4d84-175c-421b-b3ad-514582db4550 req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:44.098189 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'name': 'network-vif-deleted', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:36:44.109923 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9eee4d84-175c-421b-b3ad-514582db4550 req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.90 "DELETE /v2.0/ports/a1d19f37-64ae-4f18-a8f2-79559df44a3b HTTP/1.1" status: 204  len: 173 time: 0.8038871
May 28 14:36:44.145620 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '44daf467-480b-40ee-8e1b-567ea8d285ee', 'name': 'network-vif-deleted', 'tag': 'a1d19f37-64ae-4f18-a8f2-79559df44a3b', 'status': 'completed', 'code': 200}
May 28 14:36:45.043627 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-535212c4-9871-4cb0-9373-df8eaf407f66 req-66ee7615-1d28-46b2-9359-1f93910c6393 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Synchronizing usage tracker for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:36:45.127322 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-535212c4-9871-4cb0-9373-df8eaf407f66 req-66ee7615-1d28-46b2-9359-1f93910c6393 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Unset dirty status for tenant:c6d2d25991f04f00a48394ddbeec688e on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:36:45.128541 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-535212c4-9871-4cb0-9373-df8eaf407f66 req-66ee7615-1d28-46b2-9359-1f93910c6393 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "GET /v2.0/ports?device_id=44daf467-480b-40ee-8e1b-567ea8d285ee HTTP/1.1" status: 200  len: 210 time: 0.1268113
May 28 14:36:45.526103 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:36:46.223313 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40680) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:46.538072 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Deleting port c83e9b0d-58cd-4718-9eef-a9919d363659 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:46.538433 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:46.656568 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:46.656897 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:46.777651 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Calling delete_port for c83e9b0d-58cd-4718-9eef-a9919d363659 owned by network:floatingip {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:46.853621 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device a1d19f37-64ae-4f18-a8f2-79559df44a3b no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:36:46.889734 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: a1d19f37-64ae-4f18-a8f2-79559df44a3b {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:36:46.890083 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device a1d19f37-64ae-4f18-a8f2-79559df44a3b not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:36:46.956794 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:46.961731 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dba4524f-d8f0-4b7b-a449-03071c5aaad8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:47.009756 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event deleted for resources: {'Port': ['ID=c83e9b0d-58cd-4718-9eef-a9919d363659,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:47.039928 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:47.100033 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for floatingip, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:47.168131 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:47.169326 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-a61eb7ca-26da-4f93-b750-1a04bdec3c8a tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "DELETE /v2.0/floatingips/854345b8-80df-4572-a7ab-7dc03f1483b1 HTTP/1.1" status: 204  len: 168 time: 0.9450274
May 28 14:36:48.705649 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40698) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:48.773559 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:48.803123 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:48.916848 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:48.922399 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-b91e4cb9-ceb8-4d0c-8498-09ad28307def admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:48.939891 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe9fa133-b1e0-4e56-971e-af9cdb27b031,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:48.947884 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.948266 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.948642 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.949010 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.949861 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.950223 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.950583 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.950942 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.951303 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.951686 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.952044 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.952398 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:48.955459 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:49.006267 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:49.007407 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] 10.222.0.59 "DELETE /v2.0/security-groups/fe9fa133-b1e0-4e56-971e-af9cdb27b031 HTTP/1.1" status: 204  len: 168 time: 0.3007889
May 28 14:36:49.126975 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40706) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:49.750161 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-681900'] for router_interface, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:49.942988 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40712) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:50.159391 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Deleting port dbcc346c-8a01-43e6-927e-2d168febed7c {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:50.169813 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:50.317438 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Deleting port e45668de-7821-454f-84eb-c28db991adc2 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:50.317788 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:50.401697 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] For port dbcc346c-8a01-43e6-927e-2d168febed7c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=dbcc346c-8a01-43e6-927e-2d168febed7c,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:50.402061 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:50.437316 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:50.437667 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:50.525361 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Calling delete_port for dbcc346c-8a01-43e6-927e-2d168febed7c owned by network:router_interface {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:50.559718 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling delete_port for e45668de-7821-454f-84eb-c28db991adc2 owned by network:floatingip {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:50.740161 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:50.745619 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-523727ff-d170-433a-bd4b-3bf6838d0277 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:50.796103 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event deleted for resources: {'Port': ['ID=e45668de-7821-454f-84eb-c28db991adc2,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:50.798603 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:50.819650 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:50.823705 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-0d6a7968-719c-43fa-9660-89f415efe7e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:50.865568 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Pushing event deleted for resources: {'Port': ['ID=dbcc346c-8a01-43e6-927e-2d168febed7c,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:50.869422 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:50.900218 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for floatingip, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:50.900549 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.l3_db [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Floating IP 8452deeb-323d-434e-b8d7-b26984c4ec22 disassociated (deleted). External IP: 172.27.3.173, port: e27f7a0e-7e77-4d61-a393-fe4fde4153d5.
May 28 14:36:51.142673 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551923', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-685116'] for router_interface, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:51.369526 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Router 094f20c9-a78b-4f13-89ee-236a84d949e7 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:36:51.514358 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Router 0cb62432-a4fe-4ba8-9099-f616594e4211 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:36:51.551545 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:36:51.561238 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] Sync routers for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:36:51.570217 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:51.570823 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba23644f0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:51.613990 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:51.676700 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-748bc789-653f-4944-a2e1-08f223932b72 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "DELETE /v2.0/floatingips/8452deeb-323d-434e-b8d7-b26984c4ec22 HTTP/1.1" status: 204  len: 168 time: 1.7291331
May 28 14:36:51.676700 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:36:51.703854 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:36:51.713989 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57434404-8c37-433b-8522-dfd92db93659 None None] Sync routers for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:36:51.729963 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57434404-8c37-433b-8522-dfd92db93659 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:51.731706 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-57434404-8c37-433b-8522-dfd92db93659 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba245f1c0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:51.751283 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:51.754099 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] 10.222.0.59 "PUT /v2.0/routers/0cb62432-a4fe-4ba8-9099-f616594e4211/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6260886
May 28 14:36:51.756631 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40728) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:51.863507 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'status': 'completed', 'code': 200}
May 28 14:36:51.955717 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-57434404-8c37-433b-8522-dfd92db93659 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:52.046669 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks [] for router, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:52.105872 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b503bd1-e885-420c-88ca-db9c98203248 req-29e2a4e4-caa7-4df7-affc-7798a0034023 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:52.107345 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b503bd1-e885-420c-88ca-db9c98203248 req-29e2a4e4-caa7-4df7-affc-7798a0034023 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 1099 time: 0.2349806
May 28 14:36:52.119857 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba23644f0>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'b1668072-a83a-4a97-b60d-54f1d0a5a421', 'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'mac_address': 'fa:16:3e:05:96:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 541, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:40Z', 'updated_at': '2021-05-28T14:30:47Z', 'revision_number': 5, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'subnets': [{'id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:52.127755 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] Checking router: 094f20c9-a78b-4f13-89ee-236a84d949e7 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:36:52.134483 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:52.135252 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba23644f0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:52.286011 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa000912-f26a-41f2-a154-2a87af31673c req-ff5d23a2-1ba6-4ec0-8acf-c71da479d207 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:52.288622 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-57434404-8c37-433b-8522-dfd92db93659 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba245f1c0>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:36:50Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:52.295087 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fa000912-f26a-41f2-a154-2a87af31673c req-ff5d23a2-1ba6-4ec0-8acf-c71da479d207 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.1000047
May 28 14:36:52.295326 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57434404-8c37-433b-8522-dfd92db93659 None None] Checking router: 0cb62432-a4fe-4ba8-9099-f616594e4211 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:36:52.308145 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57434404-8c37-433b-8522-dfd92db93659 None None] Routers {'0cb62432-a4fe-4ba8-9099-f616594e4211'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:52.309373 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-57434404-8c37-433b-8522-dfd92db93659 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba245f1c0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0cb62432-a4fe-4ba8-9099-f616594e4211'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:52.334142 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:52.348175 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fa000912-f26a-41f2-a154-2a87af31673c req-ebad352d-dbe9-4bb6-b27f-e1555f15676c tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0529983
May 28 14:36:52.356635 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:52.359941 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b503bd1-e885-420c-88ca-db9c98203248 req-3e6e34d0-77ff-4947-a77b-90516b76643a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:52.361682 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b503bd1-e885-420c-88ca-db9c98203248 req-3e6e34d0-77ff-4947-a77b-90516b76643a service neutron] 10.222.0.90 "GET /v2.0/networks?id=cf0db8bd-5a73-44bf-9367-58867c9e819f HTTP/1.1" status: 200  len: 907 time: 0.2434545
May 28 14:36:52.433951 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b503bd1-e885-420c-88ca-db9c98203248 req-86169c68-76a9-4d9e-a643-52f240da0d6c service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5 HTTP/1.1" status: 200  len: 217 time: 0.0654185
May 28 14:36:52.513839 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-57434404-8c37-433b-8522-dfd92db93659 None None] Set router 0cb62432-a4fe-4ba8-9099-f616594e4211 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:52.555868 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b503bd1-e885-420c-88ca-db9c98203248 req-e68d00a0-99dc-40da-b3bb-4057256f3929 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:52.557364 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b503bd1-e885-420c-88ca-db9c98203248 req-e68d00a0-99dc-40da-b3bb-4057256f3929 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4a437a5e-a3c1-4c29-a8be-fade6c84b5f4 HTTP/1.1" status: 200  len: 845 time: 0.1162288
May 28 14:36:52.603341 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Deleting port f304788f-9f81-4703-80c4-593b1df6747b {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:52.603788 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:52.660749 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba23644f0>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'b1668072-a83a-4a97-b60d-54f1d0a5a421', 'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'mac_address': 'fa:16:3e:05:96:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 541, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:40Z', 'updated_at': '2021-05-28T14:30:47Z', 'revision_number': 5, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'subnets': [{'id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:52.665181 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b9a62d0-61ee-473b-85b6-875f43804a0c None None] The sync data for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi is: [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:30:41Z', 'revision_number': 4, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': 'b1668072-a83a-4a97-b60d-54f1d0a5a421', 'name': '', 'network_id': 'cf0db8bd-5a73-44bf-9367-58867c9e819f', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'mac_address': 'fa:16:3e:05:96:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 541, 'fixed_ips': [{'subnet_id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:40Z', 'updated_at': '2021-05-28T14:30:47Z', 'revision_number': 5, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'subnets': [{'id': '4a437a5e-a3c1-4c29-a8be-fade6c84b5f4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:36:52.864758 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-57434404-8c37-433b-8522-dfd92db93659 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba245f1c0>, [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:36:50Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:52.869248 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57434404-8c37-433b-8522-dfd92db93659 None None] The sync data for ids ['0cb62432-a4fe-4ba8-9099-f616594e4211'] in dv-cinder-791281-3-iscsi is: [{'id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'name': 'tempest-TestVolumeBootPattern-1362644589-router', 'tenant_id': 'c6d2d25991f04f00a48394ddbeec688e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133'}], 'enable_snat': True}, 'gw_port_id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:09Z', 'updated_at': '2021-05-28T14:36:50Z', 'revision_number': 5, 'project_id': 'c6d2d25991f04f00a48394ddbeec688e', 'gw_port': {'id': 'f304788f-9f81-4703-80c4-593b1df6747b', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cb62432-a4fe-4ba8-9099-f616594e4211', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:10Z', 'updated_at': '2021-05-28T14:25:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:36:52.886921 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b503bd1-e885-420c-88ca-db9c98203248 req-d85462d4-7976-4bfe-b596-ffec316131eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:52.888437 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b503bd1-e885-420c-88ca-db9c98203248 req-d85462d4-7976-4bfe-b596-ffec316131eb service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf0db8bd-5a73-44bf-9367-58867c9e819f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3224230
May 28 14:36:52.901944 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] For port f304788f-9f81-4703-80c4-593b1df6747b, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f304788f-9f81-4703-80c4-593b1df6747b,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:52.902901 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:52.925031 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b70ea19b-0fd0-412b-a8a3-146a31f38c75 None None] New status for floating IP 8452deeb-323d-434e-b8d7-b26984c4ec22: DOWN {{(pid=92697) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:36:53.099612 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Calling delete_port for f304788f-9f81-4703-80c4-593b1df6747b owned by network:router_gateway {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:53.169106 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b503bd1-e885-420c-88ca-db9c98203248 req-33559dd3-9aa9-45d4-8b66-ebf295d7ace5 service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2690961
May 28 14:36:53.234699 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device dbcc346c-8a01-43e6-927e-2d168febed7c no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:36:53.278482 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: dbcc346c-8a01-43e6-927e-2d168febed7c {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:36:53.279414 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device dbcc346c-8a01-43e6-927e-2d168febed7c not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:36:53.337328 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3b503bd1-e885-420c-88ca-db9c98203248 req-f91e16aa-afdd-4c5a-a340-06ed5425c992 service neutron] 10.222.0.90 "GET /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1594996
May 28 14:36:53.465689 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:53.469722 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-aeb29d88-3d04-4ebf-b620-ff7144f61a76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:53.542608 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Pushing event deleted for resources: {'Port': ['ID=f304788f-9f81-4703-80c4-593b1df6747b,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:53.545729 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:53.617001 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-682161'] for router_gateway, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:53.648582 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f2ccb37-4fea-4264-8885-7933ffb43d32 req-6462770d-c1a8-4b37-9d72-577e7fbd162b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:53.650050 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7f2ccb37-4fea-4264-8885-7933ffb43d32 req-6462770d-c1a8-4b37-9d72-577e7fbd162b tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.2018397
May 28 14:36:53.698066 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7f2ccb37-4fea-4264-8885-7933ffb43d32 req-956aa67b-021f-4e3a-887f-01b66637a748 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421422
May 28 14:36:53.792442 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-685628', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31078'] for router, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:53.795161 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:53.922704 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-684032'] for router, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:53.923148 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0cb62432-a4fe-4ba8-9099-f616594e4211 {{(pid=92695) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 28 14:36:53.935771 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:53.936898 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] 10.222.0.59 "DELETE /v2.0/routers/0cb62432-a4fe-4ba8-9099-f616594e4211 HTTP/1.1" status: 204  len: 168 time: 2.1791553
May 28 14:36:53.939456 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40740) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:54.005904 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-e741b072-c62d-4d4b-a826-4f5329746784 admin admin] Deleting subnet a63662e1-f44d-44cd-98c9-2b87dba66278 {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:36:54.009028 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e741b072-c62d-4d4b-a826-4f5329746784 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:54.059082 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e741b072-c62d-4d4b-a826-4f5329746784 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1610776'] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:54.200824 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-80b0818b-97b8-4f31-9683-775512fce04f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:54.201537 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-80b0818b-97b8-4f31-9683-775512fce04f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Synchronizing usage tracker for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:36:54.206710 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e741b072-c62d-4d4b-a826-4f5329746784 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:54.331039 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-80b0818b-97b8-4f31-9683-775512fce04f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Unset dirty status for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:36:54.332264 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-80b0818b-97b8-4f31-9683-775512fce04f tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.90 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.2452235
May 28 14:36:54.683060 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Deleting port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:54.684249 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:54.767365 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e741b072-c62d-4d4b-a826-4f5329746784 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1635750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1808149'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:54.781743 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:54.825188 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e741b072-c62d-4d4b-a826-4f5329746784 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a63662e1-f44d-44cd-98c9-2b87dba66278,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:54.827351 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-e741b072-c62d-4d4b-a826-4f5329746784 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:54.831157 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1790f599-fe4e-4660-8b22-8e56187f9861 None None] Network 89b0ce92-0695-466c-b1ce-9a354ecba633 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:36:54.833674 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e741b072-c62d-4d4b-a826-4f5329746784 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:54.849492 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-e741b072-c62d-4d4b-a826-4f5329746784 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/a63662e1-f44d-44cd-98c9-2b87dba66278 HTTP/1.1" status: 204  len: 168 time: 0.9068730
May 28 14:36:54.850956 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40748) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:54.918573 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da680d8c-6e80-41ff-a90d-8ec4226d803e req-ae486435-c29f-4bf2-b9ed-c5d7a0a01dbd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:36:54.920843 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-da680d8c-6e80-41ff-a90d-8ec4226d803e req-ae486435-c29f-4bf2-b9ed-c5d7a0a01dbd tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 946 time: 0.1172414
May 28 14:36:54.968539 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] For port e27f7a0e-7e77-4d61-a393-fe4fde4153d5, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:54.968954 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:54.979911 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-da680d8c-6e80-41ff-a90d-8ec4226d803e req-7c9c44bb-367b-4518-b9e2-c1fcc482d5c6 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/security-groups?id=9ab39ed0-1a7b-48aa-865b-cdecc297916b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0493660
May 28 14:36:55.107983 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] DHCP port deletion for 89b0ce92-0695-466c-b1ce-9a354ecba633 request from dv-cinder-791281-3-iscsi {{(pid=92696) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 28 14:36:55.111623 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.119791 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Calling delete_port for e27f7a0e-7e77-4d61-a393-fe4fde4153d5 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:55.177838 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] Deleting port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 {{(pid=92696) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:55.178219 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.230921 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Deleting port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:55.231259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.279873 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:36:55.328500 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] For port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:55.328789 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.388478 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] For port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:55.388828 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.460379 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] Calling delete_port for 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 owned by network:dhcp {{(pid=92696) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:55.521609 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Calling delete_port for 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 owned by network:dhcp {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:55.525918 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.534127 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8cf58b15-f15c-4b2a-83fd-92ddb410d5cd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:55.541709 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.582362 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] For port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,segment=NetworkSegment(2adec342-3afa-48b6-acc6-9f4a9ce2773e),segment_id=2adec342-3afa-48b6-acc6-9f4a9ce2773e)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:55.614253 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event deleted for resources: {'Port': ['ID=e27f7a0e-7e77-4d61-a393-fe4fde4153d5,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:55.616700 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:55.670808 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] No DVR routers for this DVR port e27f7a0e-7e77-4d61-a393-fe4fde4153d5 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:36:55.673783 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.676340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'name': 'network-vif-deleted', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:36:55.700546 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.703881 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f304788f-9f81-4703-80c4-593b1df6747b no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:36:55.728871 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2477e125-22c2-4367-b28c-0aaf5754b37c', 'name': 'network-vif-deleted', 'tag': 'e27f7a0e-7e77-4d61-a393-fe4fde4153d5', 'status': 'completed', 'code': 200}
May 28 14:36:55.730409 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:55.768513 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: f304788f-9f81-4703-80c4-593b1df6747b {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:36:55.768854 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f304788f-9f81-4703-80c4-593b1df6747b not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:36:55.791823 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7dc0ebb7-471c-4db7-86c5-6b1c91a0de5b req-31ba7af5-617e-4d57-9059-2f2e93365b16 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.90 "DELETE /v2.0/ports/e27f7a0e-7e77-4d61-a393-fe4fde4153d5 HTTP/1.1" status: 204  len: 173 time: 1.4491968
May 28 14:36:55.804272 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Pushing event updated for resources: {'Port': ['ID=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:55.812015 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.812674 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.813041 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.813377 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.813729 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.814205 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.814515 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.814844 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.815232 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.815489 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.815840 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.816160 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:36:55.819824 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980'] for port, after_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.821877 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:55.824282 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:55.824760 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:55.827301 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b5c08f8d-2ac3-4f3f-8a62-7bc030123595 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:55.866893 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] Pushing event deleted for resources: {'Port': ['ID=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,revision_number=None']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:55.870495 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:55.873020 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Pushing event deleted for resources: {'Port': ['ID=7b71eb62-5ea3-47af-aa59-795dd8ba09b9,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:55.873571 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-992e00e2-739e-4194-9d64-dd3b0d2189e9 None None] No DVR routers for this DVR port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 on host dv-cinder-791281-3-iscsi {{(pid=92696) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:36:55.876334 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:55.880684 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] No DVR routers for this DVR port 7b71eb62-5ea3-47af-aa59-795dd8ba09b9 on host dv-cinder-791281-3-iscsi {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:36:56.007216 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:56.022398 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba219bd90>,) {'filters': {'network_id': ['89b0ce92-0695-466c-b1ce-9a354ecba633']}} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:56.037437 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba219bd90>, '2adec342-3afa-48b6-acc6-9f4a9ce2773e') {'for_net_delete': True} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:56.037793 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba219bd90>, '2adec342-3afa-48b6-acc6-9f4a9ce2773e') {} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:56.054443 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1610771'] for segment, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:56.074484 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:56.082045 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Releasing vlan 867 on physical network physnet1 to pool {{(pid=92695) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:36:56.082530 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1697792'] for segment, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   util.warn(
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   util.warn(
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   util.warn(
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   util.warn(
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]: Traceback (most recent call last):
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     timer()
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     cb(*args, **kw)
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     return func(*args, **kwargs)
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     self._notify()
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     self.callback(batched_events)
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     event.method(event)
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     return f(self, *a, **k)
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._get(url).json()
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self.request(url, 'GET', **kwargs)
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:36:56.097161 dv-cinder-791281-3-iscsi neutron-server[92695]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:36:56.307116 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 req-ba0c1ad7-7af3-4023-bca9-13d2bcdbc7c1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Synchronizing usage tracker for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:36:56.430485 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 req-ba0c1ad7-7af3-4023-bca9-13d2bcdbc7c1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Unset dirty status for tenant:26daec94fed843c8b74a9ff7d18ecdb5 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:36:56.431721 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-58e3ea3a-f160-4dbb-855b-17b69933e5e7 req-ba0c1ad7-7af3-4023-bca9-13d2bcdbc7c1 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "GET /v2.0/ports?device_id=2477e125-22c2-4367-b28c-0aaf5754b37c HTTP/1.1" status: 200  len: 210 time: 0.3337226
May 28 14:36:56.432488 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:56.436885 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e18cc115-b50c-4a1f-a1ef-5704275f12cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:56.450040 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:56.461451 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Pushing event deleted for resources: {'Network': ['ID=89b0ce92-0695-466c-b1ce-9a354ecba633,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:56.465419 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:56.528018 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] 10.222.0.59 "DELETE /v2.0/networks/89b0ce92-0695-466c-b1ce-9a354ecba633 HTTP/1.1" status: 204  len: 168 time: 1.6759608
May 28 14:36:56.531247 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40758) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:56.904764 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device e27f7a0e-7e77-4d61-a393-fe4fde4153d5 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:36:56.939240 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: e27f7a0e-7e77-4d61-a393-fe4fde4153d5 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:36:56.939603 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device e27f7a0e-7e77-4d61-a393-fe4fde4153d5 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:36:57.070182 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-681900'] for router_interface, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:57.488646 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Deleting port d1893a4d-9338-4a9c-9071-849f6a2123b5 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:57.488988 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:57.527701 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40766) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:57.600688 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3e3f9693-3b13-41c2-9270-229276ae1676 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:57.611753 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] For port d1893a4d-9338-4a9c-9071-849f6a2123b5, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=d1893a4d-9338-4a9c-9071-849f6a2123b5,segment=NetworkSegment(f6996eef-8c71-4352-86d9-29ab92a9a61d),segment_id=f6996eef-8c71-4352-86d9-29ab92a9a61d)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:57.612102 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:57.632461 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3e3f9693-3b13-41c2-9270-229276ae1676 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:57.734227 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Calling delete_port for d1893a4d-9338-4a9c-9071-849f6a2123b5 owned by network:router_interface {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:57.773836 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3e3f9693-3b13-41c2-9270-229276ae1676 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:57.779866 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:57.796545 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e3f9693-3b13-41c2-9270-229276ae1676 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ab39ed0-1a7b-48aa-865b-cdecc297916b,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:57.798945 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-3e3f9693-3b13-41c2-9270-229276ae1676 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:57.859282 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-3e3f9693-3b13-41c2-9270-229276ae1676 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:57.860475 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-3e3f9693-3b13-41c2-9270-229276ae1676 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] 10.222.0.59 "DELETE /v2.0/security-groups/9ab39ed0-1a7b-48aa-865b-cdecc297916b HTTP/1.1" status: 204  len: 168 time: 0.3310776
May 28 14:36:58.000023 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40772) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:58.014576 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:58.104639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:58.110477 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5b356b00-8a0b-49f5-9f9f-63a5077c9638 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:58.155149 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Pushing event deleted for resources: {'Port': ['ID=d1893a4d-9338-4a9c-9071-849f6a2123b5,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:58.186695 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:58.444315 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551923', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-685116'] for router_interface, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:58.628249 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-681900'] for router_interface, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:58.807240 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Router 92316894-5ec1-402d-b60e-488e93b9cd37 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:36:58.998354 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:36:59.007067 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] Sync routers for ids ['92316894-5ec1-402d-b60e-488e93b9cd37'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:36:59.016555 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] Routers {'92316894-5ec1-402d-b60e-488e93b9cd37'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:59.017207 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba23dc1c0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['92316894-5ec1-402d-b60e-488e93b9cd37'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:59.051276 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Deleting port b1668072-a83a-4a97-b60d-54f1d0a5a421 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:59.051646 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:59.101413 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-3bcd4a29-50ed-4728-bf26-02148ec5f35c admin admin] 10.222.0.59 "PUT /v2.0/routers/92316894-5ec1-402d-b60e-488e93b9cd37/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5697453
May 28 14:36:59.103948 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40780) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:36:59.183973 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] For port b1668072-a83a-4a97-b60d-54f1d0a5a421, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=b1668072-a83a-4a97-b60d-54f1d0a5a421,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:59.184715 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:59.197725 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] Set router 92316894-5ec1-402d-b60e-488e93b9cd37 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:59.287384 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks [] for router, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:59.477838 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Calling delete_port for b1668072-a83a-4a97-b60d-54f1d0a5a421 owned by network:router_interface {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:36:59.489830 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:59.561669 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba23dc1c0>, [{'id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:23Z', 'updated_at': '2021-05-28T14:36:57Z', 'revision_number': 5, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'gw_port': {'id': '157c40a0-a937-4c79-a7cf-b7750bbc415d', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b1:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'device_owner': 'network:router_gateway', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:25:24Z', 'updated_at': '2021-05-28T14:25:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:59.567997 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] Checking router: 92316894-5ec1-402d-b60e-488e93b9cd37 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:36:59.581152 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] Routers {'92316894-5ec1-402d-b60e-488e93b9cd37'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:36:59.582192 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba23dc1c0>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['92316894-5ec1-402d-b60e-488e93b9cd37'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:59.734359 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:59.739796 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-dc728ee6-2b05-4f44-b953-2a2dab4c1926 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:36:59.747752 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Deleting port 157c40a0-a937-4c79-a7cf-b7750bbc415d {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:36:59.748087 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:36:59.761619 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] Set router 92316894-5ec1-402d-b60e-488e93b9cd37 gateway port host: None {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:36:59.783652 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Pushing event deleted for resources: {'Port': ['ID=b1668072-a83a-4a97-b60d-54f1d0a5a421,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:36:59.786776 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:36:59.878124 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba23dc1c0>, [{'id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:23Z', 'updated_at': '2021-05-28T14:36:59Z', 'revision_number': 6, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'gw_port_host': None}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:36:59.882415 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-514b6ff3-ac0d-4857-8e6b-1942f9d7819e None None] The sync data for ids ['92316894-5ec1-402d-b60e-488e93b9cd37'] in dv-cinder-791281-3-iscsi is: [{'id': '92316894-5ec1-402d-b60e-488e93b9cd37', 'name': 'tempest-TestVolumeBootPattern-1735660950-router', 'tenant_id': 'ad1c8d68ed024b78a40404830469679a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:25:23Z', 'updated_at': '2021-05-28T14:36:59Z', 'revision_number': 6, 'project_id': 'ad1c8d68ed024b78a40404830469679a', 'gw_port_host': None}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:36:59.899040 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] For port 157c40a0-a937-4c79-a7cf-b7750bbc415d, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=157c40a0-a937-4c79-a7cf-b7750bbc415d,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:36:59.899410 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.019476 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d983f20f-92d1-4348-bb92-a168c2922f0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.039764 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Calling delete_port for 157c40a0-a937-4c79-a7cf-b7750bbc415d owned by network:router_gateway {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:00.070288 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551923', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-685116'] for router_interface, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.248305 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.253380 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4a6a9fc-968e-4cc7-96aa-3e40fb99d1fe tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:00.299750 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Pushing event deleted for resources: {'Port': ['ID=157c40a0-a937-4c79-a7cf-b7750bbc415d,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:00.339090 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:00.393551 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-682161'] for router_gateway, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.446429 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Router 094f20c9-a78b-4f13-89ee-236a84d949e7 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:37:00.580575 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-685628', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31078'] for router, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.582670 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.650501 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:37:00.659969 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] Sync routers for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:37:00.670668 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:37:00.671427 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2364e80>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:00.687920 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-684032'] for router, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.688440 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 92316894-5ec1-402d-b60e-488e93b9cd37 {{(pid=92695) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 28 14:37:00.701000 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.702097 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-42731ff0-fad2-4a9a-ac17-219acb3b42f6 admin admin] 10.222.0.59 "DELETE /v2.0/routers/92316894-5ec1-402d-b60e-488e93b9cd37 HTTP/1.1" status: 204  len: 168 time: 1.5972500
May 28 14:37:00.704597 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40788) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:00.740443 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-c1105961-2364-4408-b7ee-4a897a68439f admin admin] 10.222.0.59 "PUT /v2.0/routers/094f20c9-a78b-4f13-89ee-236a84d949e7/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7393923
May 28 14:37:00.742903 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40792) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:00.770924 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-b6e84650-7b06-43b0-9655-c7cbbd6292e9 admin admin] Deleting subnet c066b4f0-1088-4ade-93ac-a76eb3a53395 {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:37:00.774380 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b6e84650-7b06-43b0-9655-c7cbbd6292e9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.831514 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b6e84650-7b06-43b0-9655-c7cbbd6292e9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1610776'] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.851342 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:37:00.919233 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b6e84650-7b06-43b0-9655-c7cbbd6292e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:00.970916 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks [] for router, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.143740 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2364e80>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:36:59Z', 'revision_number': 5, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:01.148032 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] Checking router: 094f20c9-a78b-4f13-89ee-236a84d949e7 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:37:01.157956 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] Routers {'094f20c9-a78b-4f13-89ee-236a84d949e7'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:37:01.158570 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2364e80>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:36:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['094f20c9-a78b-4f13-89ee-236a84d949e7'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:01.274704 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.294090 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b6e84650-7b06-43b0-9655-c7cbbd6292e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1635750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1808149'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.303907 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eaab582a-b83c-4fd6-8ffd-4e3e62ef594c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:01.340502 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b6e84650-7b06-43b0-9655-c7cbbd6292e9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.342565 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb0039d1-9389-4987-a139-169e6167a7f7 None None] Network 912c2088-541f-4bb4-8926-5637b475c28c requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:37:01.356341 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-b6e84650-7b06-43b0-9655-c7cbbd6292e9 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/c066b4f0-1088-4ade-93ac-a76eb3a53395 HTTP/1.1" status: 204  len: 168 time: 0.6505556
May 28 14:37:01.357525 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6e84650-7b06-43b0-9655-c7cbbd6292e9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c066b4f0-1088-4ade-93ac-a76eb3a53395,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:01.359293 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 157c40a0-a937-4c79-a7cf-b7750bbc415d no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:37:01.359513 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40796) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:01.363918 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] Set router 094f20c9-a78b-4f13-89ee-236a84d949e7 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:37:01.390243 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b6e84650-7b06-43b0-9655-c7cbbd6292e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:01.402753 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 157c40a0-a937-4c79-a7cf-b7750bbc415d {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:37:01.403450 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 157c40a0-a937-4c79-a7cf-b7750bbc415d not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:37:01.404065 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device d1893a4d-9338-4a9c-9071-849f6a2123b5 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:37:01.426651 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Deleting port b3e9be66-7166-49e8-824c-85e4f7c23ea5 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:37:01.427002 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.485011 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: d1893a4d-9338-4a9c-9071-849f6a2123b5 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:37:01.485822 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device d1893a4d-9338-4a9c-9071-849f6a2123b5 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:37:01.498211 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.580332 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] For port b3e9be66-7166-49e8-824c-85e4f7c23ea5, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=b3e9be66-7166-49e8-824c-85e4f7c23ea5,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:37:01.580706 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.692979 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2364e80>, [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:36:59Z', 'revision_number': 5, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:01.697880 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74af34b3-4aa0-4308-938b-503ce162fb43 None None] The sync data for ids ['094f20c9-a78b-4f13-89ee-236a84d949e7'] in dv-cinder-791281-3-iscsi is: [{'id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'name': 'tempest-TestShelveInstance-7032008-router', 'tenant_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:36Z', 'updated_at': '2021-05-28T14:36:59Z', 'revision_number': 5, 'project_id': '26daec94fed843c8b74a9ff7d18ecdb5', 'gw_port': {'id': 'b3e9be66-7166-49e8-824c-85e4f7c23ea5', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:1a:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '094f20c9-a78b-4f13-89ee-236a84d949e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:37Z', 'updated_at': '2021-05-28T14:30:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:37:01.708426 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] DHCP port deletion for 912c2088-541f-4bb4-8926-5637b475c28c request from dv-cinder-791281-3-iscsi {{(pid=92696) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 28 14:37:01.721038 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Deleting port f92cbf85-69fd-4d96-b020-3966aa3c19a3 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:37:01.722666 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.729310 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Calling delete_port for b3e9be66-7166-49e8-824c-85e4f7c23ea5 owned by network:router_gateway {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:01.807081 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] Deleting port f92cbf85-69fd-4d96-b020-3966aa3c19a3 {{(pid=92696) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:37:01.807611 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.837071 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] For port f92cbf85-69fd-4d96-b020-3966aa3c19a3, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f92cbf85-69fd-4d96-b020-3966aa3c19a3,segment=NetworkSegment(f6996eef-8c71-4352-86d9-29ab92a9a61d),segment_id=f6996eef-8c71-4352-86d9-29ab92a9a61d)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:37:01.837071 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.909379 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] For port f92cbf85-69fd-4d96-b020-3966aa3c19a3, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f92cbf85-69fd-4d96-b020-3966aa3c19a3,segment=NetworkSegment(f6996eef-8c71-4352-86d9-29ab92a9a61d),segment_id=f6996eef-8c71-4352-86d9-29ab92a9a61d)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:37:01.909677 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:01.960244 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Calling delete_port for f92cbf85-69fd-4d96-b020-3966aa3c19a3 owned by network:dhcp {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:01.996414 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.006924 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d0b65f57-ea61-443a-811a-4ac71fd88a25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:02.033788 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] Calling delete_port for f92cbf85-69fd-4d96-b020-3966aa3c19a3 owned by network:dhcp {{(pid=92696) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:02.051827 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Pushing event deleted for resources: {'Port': ['ID=b3e9be66-7166-49e8-824c-85e4f7c23ea5,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:02.054491 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:02.087864 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.093612 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-ef141be8-18b0-41b8-83c5-85a5588010c2 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:02.094717 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980'] for port, after_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.098532 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:02.147401 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] Pushing event deleted for resources: {'Port': ['ID=f92cbf85-69fd-4d96-b020-3966aa3c19a3,revision_number=None']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:02.156229 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] No DVR routers for this DVR port f92cbf85-69fd-4d96-b020-3966aa3c19a3 on host dv-cinder-791281-3-iscsi {{(pid=92696) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:37:02.161543 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-85806736-c684-4f55-9116-35e6cc6fe6f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:02.168746 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Pushing event deleted for resources: {'Port': ['ID=f92cbf85-69fd-4d96-b020-3966aa3c19a3,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:02.170801 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] No DVR routers for this DVR port f92cbf85-69fd-4d96-b020-3966aa3c19a3 on host dv-cinder-791281-3-iscsi {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:37:02.172595 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:02.183157 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-682161'] for router_gateway, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.295533 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.308961 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba064ff10>,) {'filters': {'network_id': ['912c2088-541f-4bb4-8926-5637b475c28c']}} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:02.322626 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba064ff10>, 'f6996eef-8c71-4352-86d9-29ab92a9a61d') {'for_net_delete': True} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:02.322898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba064ff10>, 'f6996eef-8c71-4352-86d9-29ab92a9a61d') {} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:02.335999 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1610771'] for segment, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.354564 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.361150 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Releasing vlan 864 on physical network physnet1 to pool {{(pid=92695) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:37:02.361575 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1697792'] for segment, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.362605 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-685628', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31078'] for router, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.364806 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]: Traceback (most recent call last):
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     timer()
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     cb(*args, **kw)
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     return func(*args, **kwargs)
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     self._notify()
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     self.callback(batched_events)
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     event.method(event)
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     return f(self, *a, **k)
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._get(url).json()
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self.request(url, 'GET', **kwargs)
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:37:02.375765 dv-cinder-791281-3-iscsi neutron-server[92695]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:37:02.494124 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-684032'] for router, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.494733 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 094f20c9-a78b-4f13-89ee-236a84d949e7 {{(pid=92694) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 28 14:37:02.507404 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] Notify callbacks [] for router, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.508699 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-4619c26b-4d44-4cb0-8f6c-966755aaa46e admin admin] 10.222.0.59 "DELETE /v2.0/routers/094f20c9-a78b-4f13-89ee-236a84d949e7 HTTP/1.1" status: 204  len: 168 time: 1.7636359
May 28 14:37:02.511267 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40804) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:02.516825 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.522081 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.529718 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:02.549231 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Pushing event deleted for resources: {'Network': ['ID=912c2088-541f-4bb4-8926-5637b475c28c,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:02.551719 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:02.556220 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c04a19f2-034d-42b0-b801-5dbe24d7c668 admin admin] 10.222.0.59 "DELETE /v2.0/networks/912c2088-541f-4bb4-8926-5637b475c28c HTTP/1.1" status: 204  len: 168 time: 1.1915522
May 28 14:37:02.581330 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_v2 [None req-2939bec5-9e7a-4766-9014-1fc1a22999ce admin admin] Deleting subnet 4a437a5e-a3c1-4c29-a8be-fade6c84b5f4 {{(pid=92694) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:37:02.585164 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2939bec5-9e7a-4766-9014-1fc1a22999ce admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.586071 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-09edea77-121e-4190-a31d-5b3a4eec192e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.588051 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.646621 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2939bec5-9e7a-4766-9014-1fc1a22999ce admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1655020'] for subnet, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.729067 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2939bec5-9e7a-4766-9014-1fc1a22999ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:02.908104 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40812) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:02.975322 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-671cc507-5c04-4e08-9f8d-eaa272318e62 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c6d2d25991f04f00a48394ddbeec688e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0656691
May 28 14:37:02.977585 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40816) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:03.044597 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-832a5853-50c6-4782-afd4-bb9be6e9047b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.076404 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-832a5853-50c6-4782-afd4-bb9be6e9047b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.094115 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2939bec5-9e7a-4766-9014-1fc1a22999ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3483512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3521832'] for subnet, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.098486 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e8adaba0-dcbe-479c-a4f4-c9f6d577a11d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:03.134351 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2939bec5-9e7a-4766-9014-1fc1a22999ce admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4a437a5e-a3c1-4c29-a8be-fade6c84b5f4,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:03.139682 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-2939bec5-9e7a-4766-9014-1fc1a22999ce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.142942 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2939bec5-9e7a-4766-9014-1fc1a22999ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:03.147458 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-2939bec5-9e7a-4766-9014-1fc1a22999ce admin admin] 10.222.0.59 "DELETE /v2.0/subnets/4a437a5e-a3c1-4c29-a8be-fade6c84b5f4 HTTP/1.1" status: 204  len: 168 time: 0.6349907
May 28 14:37:03.148117 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb8acc7e-16aa-452c-b19a-521b3170fe07 None None] Network cf0db8bd-5a73-44bf-9367-58867c9e819f requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:37:03.149952 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40820) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:03.190816 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-832a5853-50c6-4782-afd4-bb9be6e9047b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.194817 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-dc6db586-3cc0-4be5-994f-07ccd378c1b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:03.213330 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-832a5853-50c6-4782-afd4-bb9be6e9047b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d0efde2-fb63-41f2-837f-f88e56c16cc3,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:03.216159 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-832a5853-50c6-4782-afd4-bb9be6e9047b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:03.223135 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-832a5853-50c6-4782-afd4-bb9be6e9047b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.224681 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-832a5853-50c6-4782-afd4-bb9be6e9047b admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7d0efde2-fb63-41f2-837f-f88e56c16cc3 HTTP/1.1" status: 204  len: 168 time: 0.2459388
May 28 14:37:03.338232 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device b3e9be66-7166-49e8-824c-85e4f7c23ea5 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:37:03.363707 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.383524 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: b3e9be66-7166-49e8-824c-85e4f7c23ea5 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:37:03.383879 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device b3e9be66-7166-49e8-824c-85e4f7c23ea5 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:37:03.384303 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device b1668072-a83a-4a97-b60d-54f1d0a5a421 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:37:03.421255 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: b1668072-a83a-4a97-b60d-54f1d0a5a421 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:37:03.421595 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device b1668072-a83a-4a97-b60d-54f1d0a5a421 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:37:03.422012 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f92cbf85-69fd-4d96-b020-3966aa3c19a3 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:37:03.438632 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Deleting port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:37:03.438971 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.497505 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: f92cbf85-69fd-4d96-b020-3966aa3c19a3 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:37:03.497990 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f92cbf85-69fd-4d96-b020-3966aa3c19a3 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:37:03.546830 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] For port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=1a7a8e2b-102b-4640-a14f-f3ec6f33841c,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:37:03.547192 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.569899 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] DHCP port deletion for cf0db8bd-5a73-44bf-9367-58867c9e819f request from dv-cinder-791281-3-iscsi {{(pid=92696) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 28 14:37:03.637464 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] Deleting port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c {{(pid=92696) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:37:03.638162 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.677241 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Calling delete_port for 1a7a8e2b-102b-4640-a14f-f3ec6f33841c owned by network:dhcp {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:03.753230 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] For port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=1a7a8e2b-102b-4640-a14f-f3ec6f33841c,segment=NetworkSegment(1813f8c2-f7d0-4718-afc9-11b527ec49a2),segment_id=1813f8c2-f7d0-4718-afc9-11b527ec49a2)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:37:03.753622 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.796774 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.800678 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4a3c1965-c8c1-4470-9cde-975ec35544d1 tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:03.818578 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.845172 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Pushing event deleted for resources: {'Port': ['ID=1a7a8e2b-102b-4640-a14f-f3ec6f33841c,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:03.848278 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:03.849053 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] No DVR routers for this DVR port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c on host dv-cinder-791281-3-iscsi {{(pid=92694) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:37:03.880885 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] Calling delete_port for 1a7a8e2b-102b-4640-a14f-f3ec6f33841c owned by network:dhcp {{(pid=92696) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:03.923156 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980'] for port, after_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.926820 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-91746860-672a-4654-88f2-e50e3ee25613 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:03.965732 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40828) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:03.971085 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:03.971454 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] Pushing event deleted for resources: {'Port': ['ID=1a7a8e2b-102b-4640-a14f-f3ec6f33841c,revision_number=None']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:03.977119 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:03.978004 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8950cf5d-3331-4570-8014-4be3a98dd808 None None] No DVR routers for this DVR port 1a7a8e2b-102b-4640-a14f-f3ec6f33841c on host dv-cinder-791281-3-iscsi {{(pid=92696) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:37:03.990504 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba10c4310>,) {'filters': {'network_id': ['cf0db8bd-5a73-44bf-9367-58867c9e819f']}} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:03.999948 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba10c4310>, '1813f8c2-f7d0-4718-afc9-11b527ec49a2') {'for_net_delete': True} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:04.000250 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba10c4310>, '1813f8c2-f7d0-4718-afc9-11b527ec49a2') {} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:04.012654 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1655015'] for segment, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:04.025615 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-34d9967b-c0b4-4841-bdac-f9d5e35def28 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=ad1c8d68ed024b78a40404830469679a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0585933
May 28 14:37:04.028313 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40834) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:04.031627 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:04.039240 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Releasing vlan 880 on physical network physnet1 to pool {{(pid=92694) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:37:04.040031 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3422942'] for segment, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]: Traceback (most recent call last):
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     timer()
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     cb(*args, **kw)
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     return func(*args, **kwargs)
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     self._notify()
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     self.callback(batched_events)
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     event.method(event)
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     return f(self, *a, **k)
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._get(url).json()
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self.request(url, 'GET', **kwargs)
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:37:04.055068 dv-cinder-791281-3-iscsi neutron-server[92694]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:37:04.096931 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-296421ec-f88f-43be-9939-841f2d8c2be8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:04.128210 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-296421ec-f88f-43be-9939-841f2d8c2be8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:04.213654 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:04.217974 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:04.231451 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:04.241767 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Pushing event deleted for resources: {'Network': ['ID=cf0db8bd-5a73-44bf-9367-58867c9e819f,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:04.245240 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:04.270981 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-296421ec-f88f-43be-9939-841f2d8c2be8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:04.274845 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-00917813-a4ee-4f81-9334-f78a57a84395 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:04.286625 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-296421ec-f88f-43be-9939-841f2d8c2be8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acaa7c11-1c9e-441b-a131-87776bc22c73,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:04.290893 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-296421ec-f88f-43be-9939-841f2d8c2be8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:04.294067 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-296421ec-f88f-43be-9939-841f2d8c2be8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:04.295182 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-296421ec-f88f-43be-9939-841f2d8c2be8 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/acaa7c11-1c9e-441b-a131-87776bc22c73 HTTP/1.1" status: 204  len: 168 time: 0.2657385
May 28 14:37:04.334919 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-a09cfe7d-3fce-48bc-a87a-c0351f868597 admin admin] 10.222.0.59 "DELETE /v2.0/networks/cf0db8bd-5a73-44bf-9367-58867c9e819f HTTP/1.1" status: 204  len: 168 time: 1.1837363
May 28 14:37:04.337727 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40840) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:04.923600 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-681900'] for router_interface, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:05.279232 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 1a7a8e2b-102b-4640-a14f-f3ec6f33841c no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:37:05.320829 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 1a7a8e2b-102b-4640-a14f-f3ec6f33841c {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:37:05.321170 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 1a7a8e2b-102b-4640-a14f-f3ec6f33841c not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:37:05.409255 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:05.462893 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Deleting port 7aa04697-2281-4622-afa7-1e7ddb397354 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:37:05.463491 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:05.590722 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] For port 7aa04697-2281-4622-afa7-1e7ddb397354, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=7aa04697-2281-4622-afa7-1e7ddb397354,segment=NetworkSegment(f0502c45-65a2-4857-a8a8-8ecc114c3345),segment_id=f0502c45-65a2-4857-a8a8-8ecc114c3345)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:37:05.591091 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:05.716629 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Calling delete_port for 7aa04697-2281-4622-afa7-1e7ddb397354 owned by network:router_interface {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:05.910570 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:05.915233 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ca5abecd-29f3-4a40-b4c1-3462e312518d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:05.987579 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Pushing event deleted for resources: {'Port': ['ID=7aa04697-2281-4622-afa7-1e7ddb397354,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:05.990049 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:06.234727 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551923', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-685116'] for router_interface, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:06.692746 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:37:06.873736 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:37:06.881759 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] Sync routers for ids ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'] in dv-cinder-791281-3-iscsi {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:37:06.891526 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] Routers {'0380fcc5-9edc-4ff3-a388-0ab4421ac662'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:37:06.892695 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba18ae430>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:37:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:06.935584 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] 10.222.0.59 "PUT /v2.0/routers/0380fcc5-9edc-4ff3-a388-0ab4421ac662/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5965776
May 28 14:37:06.938316 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40848) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:07.070201 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] Set router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:37:07.115178 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks [] for router, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:07.291361 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:07.359518 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba18ae430>, [{'id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:46Z', 'updated_at': '2021-05-28T14:37:05Z', 'revision_number': 5, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'gw_port': {'id': '9d1eb889-320f-4f14-a650-410e2b77cc8e', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:a4:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:30:48Z', 'updated_at': '2021-05-28T14:30:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:07.363231 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] Checking router: 0380fcc5-9edc-4ff3-a388-0ab4421ac662 for host: dv-cinder-791281-3-iscsi {{(pid=92696) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:37:07.372423 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] Routers {'0380fcc5-9edc-4ff3-a388-0ab4421ac662'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92696) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:37:07.373625 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba18ae430>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:37:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'], 'active': True} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:07.451676 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Deleting port 9d1eb889-320f-4f14-a650-410e2b77cc8e {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:37:07.452088 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:07.526132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvr_db [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] Set router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 gateway port host: None {{(pid=92696) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:37:07.634988 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_hamode_db [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba18ae430>, [{'id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:46Z', 'updated_at': '2021-05-28T14:37:07Z', 'revision_number': 6, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'gw_port_host': None}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92696) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:07.643719 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25930b03-7fba-4d3d-82af-2f1e6ec34c4d None None] The sync data for ids ['0380fcc5-9edc-4ff3-a388-0ab4421ac662'] in dv-cinder-791281-3-iscsi is: [{'id': '0380fcc5-9edc-4ff3-a388-0ab4421ac662', 'name': 'tempest-TestShelveInstance-455735731-router', 'tenant_id': 'c8294323eb2a41b6875b41f3ee440d11', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:30:46Z', 'updated_at': '2021-05-28T14:37:07Z', 'revision_number': 6, 'project_id': 'c8294323eb2a41b6875b41f3ee440d11', 'gw_port_host': None}] {{(pid=92696) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:37:07.692899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] For port 9d1eb889-320f-4f14-a650-410e2b77cc8e, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=9d1eb889-320f-4f14-a650-410e2b77cc8e,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:37:07.693257 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:07.813799 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Calling delete_port for 9d1eb889-320f-4f14-a650-410e2b77cc8e owned by network:router_gateway {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:08.007107 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.011141 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-8d8eb8bd-839b-45fa-8719-cff90a11feff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:08.060733 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Pushing event deleted for resources: {'Port': ['ID=9d1eb889-320f-4f14-a650-410e2b77cc8e,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:08.091658 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:08.149398 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-682161'] for router_gateway, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.322422 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-685628', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31078'] for router, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.324464 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.402302 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-684032'] for router, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.403461 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0380fcc5-9edc-4ff3-a388-0ab4421ac662 {{(pid=92695) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 28 14:37:08.416675 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Notify callbacks [] for router, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.418668 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] 10.222.0.59 "DELETE /v2.0/routers/0380fcc5-9edc-4ff3-a388-0ab4421ac662 HTTP/1.1" status: 204  len: 168 time: 1.4785480
May 28 14:37:08.420455 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40856) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:08.483827 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_v2 [None req-b239a28c-2d0c-4f68-a83b-0b51e65720b9 admin admin] Deleting subnet e680abde-f402-47b8-b002-0b0e1d84f679 {{(pid=92695) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:37:08.487124 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b239a28c-2d0c-4f68-a83b-0b51e65720b9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.537009 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b239a28c-2d0c-4f68-a83b-0b51e65720b9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1610776'] for subnet, precommit_delete_associations {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.620632 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b239a28c-2d0c-4f68-a83b-0b51e65720b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.951410 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b239a28c-2d0c-4f68-a83b-0b51e65720b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1635750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1808149'] for subnet, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:08.956253 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:08.994154 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b239a28c-2d0c-4f68-a83b-0b51e65720b9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e680abde-f402-47b8-b002-0b0e1d84f679,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:08.996719 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-b239a28c-2d0c-4f68-a83b-0b51e65720b9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.000182 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b239a28c-2d0c-4f68-a83b-0b51e65720b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:09.000379 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f74f443-8f1b-4efb-b81a-8316910c89d7 None None] Network 69506df2-d621-488b-81b1-55216d075161 requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:37:09.004380 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-b239a28c-2d0c-4f68-a83b-0b51e65720b9 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/e680abde-f402-47b8-b002-0b0e1d84f679 HTTP/1.1" status: 204  len: 168 time: 0.5829930
May 28 14:37:09.006963 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40862) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:09.110347 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.186047 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Deleting port f9b4260c-0936-47d8-82c5-881b618de08a {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:37:09.186388 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.283753 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] DHCP port deletion for 69506df2-d621-488b-81b1-55216d075161 request from dv-cinder-791281-3-iscsi {{(pid=92696) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 28 14:37:09.315401 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 9d1eb889-320f-4f14-a650-410e2b77cc8e no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:37:09.362172 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 9d1eb889-320f-4f14-a650-410e2b77cc8e {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:37:09.362509 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 9d1eb889-320f-4f14-a650-410e2b77cc8e not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:37:09.362943 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 7aa04697-2281-4622-afa7-1e7ddb397354 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:37:09.402086 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] For port f9b4260c-0936-47d8-82c5-881b618de08a, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f9b4260c-0936-47d8-82c5-881b618de08a,segment=NetworkSegment(f0502c45-65a2-4857-a8a8-8ecc114c3345),segment_id=f0502c45-65a2-4857-a8a8-8ecc114c3345)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:37:09.402358 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 7aa04697-2281-4622-afa7-1e7ddb397354 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:37:09.402487 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.402597 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 7aa04697-2281-4622-afa7-1e7ddb397354 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:37:09.423813 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] Deleting port f9b4260c-0936-47d8-82c5-881b618de08a {{(pid=92696) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:37:09.424194 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.522671 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] For port f9b4260c-0936-47d8-82c5-881b618de08a, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=f9b4260c-0936-47d8-82c5-881b618de08a,segment=NetworkSegment(f0502c45-65a2-4857-a8a8-8ecc114c3345),segment_id=f0502c45-65a2-4857-a8a8-8ecc114c3345)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:37:09.522954 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.524112 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Calling delete_port for f9b4260c-0936-47d8-82c5-881b618de08a owned by network:dhcp {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:09.646131 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] Calling delete_port for f9b4260c-0936-47d8-82c5-881b618de08a owned by network:dhcp {{(pid=92696) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:37:09.648436 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.654045 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-71aae6e7-2653-481b-8bf9-150dd6b81bff tempest-AttachVolumeNegativeTest-189354397 tempest-AttachVolumeNegativeTest-189354397-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:09.690023 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980'] for port, after_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.693603 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:09.699523 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Pushing event deleted for resources: {'Port': ['ID=f9b4260c-0936-47d8-82c5-881b618de08a,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:09.702489 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:09.703485 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] No DVR routers for this DVR port f9b4260c-0936-47d8-82c5-881b618de08a on host dv-cinder-791281-3-iscsi {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:37:09.737283 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] Pushing event deleted for resources: {'Port': ['ID=f9b4260c-0936-47d8-82c5-881b618de08a,revision_number=None']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:09.742529 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] No DVR routers for this DVR port f9b4260c-0936-47d8-82c5-881b618de08a on host dv-cinder-791281-3-iscsi {{(pid=92696) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:37:09.742529 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-d6bdec9a-2903-47dc-81c0-1a098a82f570 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:09.823532 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.836671 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba1ab9880>,) {'filters': {'network_id': ['69506df2-d621-488b-81b1-55216d075161']}} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:09.849328 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba1ab9880>, 'f0502c45-65a2-4857-a8a8-8ecc114c3345') {'for_net_delete': True} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:09.849619 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.services.segments.db [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba1ab9880>, 'f0502c45-65a2-4857-a8a8-8ecc114c3345') {} {{(pid=92695) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:37:09.861831 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1610771'] for segment, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.878101 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.883897 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Releasing vlan 873 on physical network physnet1 to pool {{(pid=92695) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:37:09.884273 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1697792'] for segment, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]: Traceback (most recent call last):
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     timer()
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     cb(*args, **kw)
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     return func(*args, **kwargs)
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     self._notify()
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     self.callback(batched_events)
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     event.method(event)
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     return f(self, *a, **k)
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._get(url).json()
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     return self.request(url, 'GET', **kwargs)
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:37:09.899341 dv-cinder-791281-3-iscsi neutron-server[92695]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:37:10.030703 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:10.034195 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-0b399963-d13a-48a1-aba9-b334b1227ee8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:10.047537 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:10.057430 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Pushing event deleted for resources: {'Network': ['ID=69506df2-d621-488b-81b1-55216d075161,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:10.062105 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:10.065717 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-103aa82b-06b8-4062-b686-d5f1543e1afb admin admin] 10.222.0.59 "DELETE /v2.0/networks/69506df2-d621-488b-81b1-55216d075161 HTTP/1.1" status: 204  len: 168 time: 1.0578175
May 28 14:37:10.441094 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40870) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:10.490024 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-f310f74c-9151-4f8d-8a5e-35f7740eac2e admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=26daec94fed843c8b74a9ff7d18ecdb5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0477042
May 28 14:37:10.492414 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40874) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:10.549247 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-58293e8f-e67e-4f27-a170-d75044b54246 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:10.574002 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-58293e8f-e67e-4f27-a170-d75044b54246 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:10.710379 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-58293e8f-e67e-4f27-a170-d75044b54246 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:10.714115 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-530a519e-b939-41bf-9107-c4e8ed11e990 tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:10.726105 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58293e8f-e67e-4f27-a170-d75044b54246 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77ee19df-86c8-4660-997d-e1674cca7f09,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:10.729650 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-58293e8f-e67e-4f27-a170-d75044b54246 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:10.735318 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-58293e8f-e67e-4f27-a170-d75044b54246 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:10.737030 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-58293e8f-e67e-4f27-a170-d75044b54246 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/77ee19df-86c8-4660-997d-e1674cca7f09 HTTP/1.1" status: 204  len: 168 time: 0.2431738
May 28 14:37:11.278284 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f9b4260c-0936-47d8-82c5-881b618de08a no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:37:11.307365 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: f9b4260c-0936-47d8-82c5-881b618de08a {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:37:11.307739 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device f9b4260c-0936-47d8-82c5-881b618de08a not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:37:11.430126 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 40884) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:11.485789 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-c1f911f0-3cce-4dab-b421-7badb3035394 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=c8294323eb2a41b6875b41f3ee440d11&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0544412
May 28 14:37:11.488553 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 40888) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:37:11.548067 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f2afc7eb-57ee-4267-8595-199a9b046fcd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:11.579409 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f2afc7eb-57ee-4267-8595-199a9b046fcd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:11.750551 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f2afc7eb-57ee-4267-8595-199a9b046fcd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:11.754469 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8c6f7fe3-b653-4858-80e0-6bb4e63f436b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:37:11.768198 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2afc7eb-57ee-4267-8595-199a9b046fcd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25ccd21f-41fd-40ae-8c6f-8678f97ae79a,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:37:11.772051 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f2afc7eb-57ee-4267-8595-199a9b046fcd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:37:11.775254 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f2afc7eb-57ee-4267-8595-199a9b046fcd admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:11.776413 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-f2afc7eb-57ee-4267-8595-199a9b046fcd admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/25ccd21f-41fd-40ae-8c6f-8678f97ae79a HTTP/1.1" status: 204  len: 168 time: 0.2868443
May 28 14:37:22.524473 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:37:28.030065 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:30.030699 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-36caea14-333f-4be9-835a-200b44b97cdf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:32.543936 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:32.566728 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7f7b0fd1-16e7-4521-971f-1d541beb65c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:33.767096 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:35.349848 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:51.052352 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083c1918-e428-48bd-9133-54243c159f8c req-4312fd8d-e3d0-4e14-b8e1-cdd5df136ad5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:37:51.053808 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-083c1918-e428-48bd-9133-54243c159f8c req-4312fd8d-e3d0-4e14-b8e1-cdd5df136ad5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0815427
May 28 14:37:51.099028 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-083c1918-e428-48bd-9133-54243c159f8c req-b36c592e-e8e0-44bd-85f0-9cc9f32f9c2a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391917
May 28 14:37:52.292961 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ea7018-b101-4245-b864-6eb3452ffbcb req-bcd90c73-720e-457e-a495-0459cd378e17 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:37:52.294435 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d8ea7018-b101-4245-b864-6eb3452ffbcb req-bcd90c73-720e-457e-a495-0459cd378e17 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0845251
May 28 14:37:52.340125 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-d8ea7018-b101-4245-b864-6eb3452ffbcb req-7f309c8b-83b5-4351-bb8c-60e0c28326b7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398936
May 28 14:37:53.526388 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeebd241-c246-4aee-a725-a1a02d9f4da8 req-dce3543b-bcce-4b59-8906-01537abe4252 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:37:53.527795 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-eeebd241-c246-4aee-a725-a1a02d9f4da8 req-dce3543b-bcce-4b59-8906-01537abe4252 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0827436
May 28 14:37:53.571071 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-eeebd241-c246-4aee-a725-a1a02d9f4da8 req-ff5f8f4c-bbaa-43a1-b25a-e212773f0b04 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0371115
May 28 14:37:54.764603 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20529824-ee37-416c-92a8-bb55635edd82 req-33dcf5ca-e8eb-413b-ad55-ba52a76c9c81 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:37:54.766043 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-20529824-ee37-416c-92a8-bb55635edd82 req-33dcf5ca-e8eb-413b-ad55-ba52a76c9c81 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0817819
May 28 14:37:54.812507 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-20529824-ee37-416c-92a8-bb55635edd82 req-287c91d8-3d98-4c2d-bc3e-8b1442ffe80e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403595
May 28 14:37:56.003899 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 req-770bbd65-a0ba-4163-970c-fe0e7ee9a707 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:37:56.005460 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 req-770bbd65-a0ba-4163-970c-fe0e7ee9a707 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0809045
May 28 14:37:56.055370 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-ee6a5e83-badc-4cfc-adea-9f33b7627c18 req-586d34e4-81de-49b9-b088-d91d4a1c6483 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441701
May 28 14:37:57.239198 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 req-05d868d9-aa39-4c77-b9cd-e1d77376b67b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:37:57.240690 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 req-05d868d9-aa39-4c77-b9cd-e1d77376b67b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0797310
May 28 14:37:57.288316 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-dd6306b5-7f1b-4201-9d57-dd02b94753a2 req-e19c4c4a-e69c-4dc0-bfa0-19fafdb96f3c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416563
May 28 14:37:57.983140 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:37:58.481527 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6262bc4-1007-4786-8135-4bd6198f2cfa req-e6290dd4-26a0-4c62-9afb-f0344b8ee4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:37:58.483018 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c6262bc4-1007-4786-8135-4bd6198f2cfa req-e6290dd4-26a0-4c62-9afb-f0344b8ee4da tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0853381
May 28 14:37:58.532476 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c6262bc4-1007-4786-8135-4bd6198f2cfa req-4d1f141b-0ce3-4691-b287-3d3ed073fe99 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423217
May 28 14:37:59.524431 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:37:59.719538 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 req-3b44ce2a-57ca-4c5a-9fc7-beca3779b490 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:37:59.721053 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 req-3b44ce2a-57ca-4c5a-9fc7-beca3779b490 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0807378
May 28 14:37:59.765815 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5d5d1f5a-1aa0-4374-80ac-b0a87bae4428 req-10431cf0-909c-4c5a-98bd-bd91ce629d48 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391846
May 28 14:38:00.012033 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-785809fc-d773-4ebb-b006-9f76499f9791 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:00.958504 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf9cc80-9194-419e-b008-08063dfd5c1e req-8b9244be-e7f9-495a-b49a-c3dcc5e0e3fe tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:00.959998 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3bf9cc80-9194-419e-b008-08063dfd5c1e req-8b9244be-e7f9-495a-b49a-c3dcc5e0e3fe tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0882833
May 28 14:38:01.011653 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-3bf9cc80-9194-419e-b008-08063dfd5c1e req-dada45b1-d056-4ed0-b37c-3569cd0866d5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0459063
May 28 14:38:02.202006 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7b02d0-48b4-4667-8ac6-048446534099 req-8444fa38-2572-49d3-9dc3-4077a1a154c5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:02.203468 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ca7b02d0-48b4-4667-8ac6-048446534099 req-8444fa38-2572-49d3-9dc3-4077a1a154c5 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0868666
May 28 14:38:02.249390 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ca7b02d0-48b4-4667-8ac6-048446534099 req-1cc19bb2-e426-4fe3-a4c2-8fb99ab323e7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394480
May 28 14:38:02.548746 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:02.559895 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4673eae4-f891-447b-8741-08d7509db8e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:03.438232 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e48b449-ab7a-404a-9a5a-c26843d270de req-57b3202d-4a8a-4bcb-b46d-e9e8a3685eab tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:03.439755 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2e48b449-ab7a-404a-9a5a-c26843d270de req-57b3202d-4a8a-4bcb-b46d-e9e8a3685eab tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0841935
May 28 14:38:03.483388 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2e48b449-ab7a-404a-9a5a-c26843d270de req-e45f53d0-20e8-4ee8-b2f8-a86f00924d10 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379891
May 28 14:38:03.778736 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:04.664769 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e512a21-bf9b-41f8-aebc-3dc610379271 req-2cb75cce-de21-48bd-9146-976e2a45109a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:04.666203 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6e512a21-bf9b-41f8-aebc-3dc610379271 req-2cb75cce-de21-48bd-9146-976e2a45109a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0789793
May 28 14:38:04.709615 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-6e512a21-bf9b-41f8-aebc-3dc610379271 req-3c6ae4ff-5f26-4758-a7e8-2a4b8d64af45 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0377676
May 28 14:38:05.365466 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:05.896717 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 req-d9858bca-f6af-4a6c-a7e3-6c72c248e94a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:05.898157 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 req-d9858bca-f6af-4a6c-a7e3-6c72c248e94a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0844102
May 28 14:38:05.947617 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-04ce0d3a-2df7-42f2-ac1a-5bd9501af103 req-dddcbd18-121f-48cc-95ae-08699ec6a81a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0437255
May 28 14:38:07.137731 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09d6185-6991-49f3-8981-882130579713 req-fc07fd6f-4bb5-4d59-bc6b-5ca7529a569b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:07.139112 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e09d6185-6991-49f3-8981-882130579713 req-fc07fd6f-4bb5-4d59-bc6b-5ca7529a569b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0842941
May 28 14:38:07.184126 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-e09d6185-6991-49f3-8981-882130579713 req-e2fe4ecd-8dab-4b57-8ec7-c2bc7e52d858 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382576
May 28 14:38:07.704778 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be req-fec3e596-2470-448a-8670-17a3ae4cc8e6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:07.706220 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be req-fec3e596-2470-448a-8670-17a3ae4cc8e6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0793695
May 28 14:38:07.750805 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-fd3eb134-8aa0-4c87-bdee-5f13a299f2be req-1b75a51e-e47f-411f-bb56-0e0ce522213d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387728
May 28 14:38:07.812477 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-51b1dbf7-ef7a-49b3-95c9-205a23b39dd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:07.814525 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-51b1dbf7-ef7a-49b3-95c9-205a23b39dd7 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 1099 time: 0.0732126
May 28 14:38:07.949838 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-b60ecf3f-c549-4251-ab7e-90d47735d7c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:07.951284 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-b60ecf3f-c549-4251-ab7e-90d47735d7c0 service neutron] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 910 time: 0.1300683
May 28 14:38:08.150690 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-45a821c0-aea1-4a90-a41c-2858e70c85d2 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab HTTP/1.1" status: 200  len: 1002 time: 0.1922646
May 28 14:38:08.213304 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-6991b17f-128f-434f-9819-da76d37b2e9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:08.214778 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-6991b17f-128f-434f-9819-da76d37b2e9a service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0574877
May 28 14:38:08.291882 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-a9fe1ca3-86b6-42f8-8c2e-2404347358ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:08.293360 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-a9fe1ca3-86b6-42f8-8c2e-2404347358ed service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0712552
May 28 14:38:08.425430 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-8be6ac20-5405-42d7-b72d-7999ac197e55 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1247172
May 28 14:38:08.556889 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-f5dc718f-20df-43cd-81dd-71e56dc9a2cf req-a1d7d310-5369-4832-a6a9-08715ea51405 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1243556
May 28 14:38:08.939021 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78298ef-953f-468e-8b89-ae8707ac83d2 req-55c4241c-70da-4031-80c8-3c4b840e3d07 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:08.940515 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e78298ef-953f-468e-8b89-ae8707ac83d2 req-55c4241c-70da-4031-80c8-3c4b840e3d07 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0802889
May 28 14:38:08.984915 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e78298ef-953f-468e-8b89-ae8707ac83d2 req-21cbb8d2-8e2a-4ec7-aff5-74aed7bb5a5d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388477
May 28 14:38:10.173479 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09941aea-2c4a-46c7-91c0-9a3150fd007c req-d3cba45b-e48e-42f0-b0de-8147a77066cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:10.174847 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-09941aea-2c4a-46c7-91c0-9a3150fd007c req-d3cba45b-e48e-42f0-b0de-8147a77066cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0839853
May 28 14:38:10.218099 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-09941aea-2c4a-46c7-91c0-9a3150fd007c req-91bdf420-0adb-43f1-bbaa-7bf3486665f2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0375626
May 28 14:38:28.010682 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:30.022110 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d13c398b-9115-439b-881f-6d79181c979c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:32.530146 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:32.565082 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f2faba94-9606-44c1-8d8c-987918523b53 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:33.735912 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:35.364756 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:36.523454 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:38:38.547099 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-add3703f-dbec-4356-b373-7c8530671cd1 req-a62671e1-8ec0-4008-be96-54c36d02b244 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0741954
May 28 14:38:38.686470 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add3703f-dbec-4356-b373-7c8530671cd1 req-5c1eb59f-0d2b-419c-b184-a4097df4b994 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:38.687940 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-add3703f-dbec-4356-b373-7c8530671cd1 req-5c1eb59f-0d2b-419c-b184-a4097df4b994 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 1099 time: 0.0707066
May 28 14:38:38.844063 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add3703f-dbec-4356-b373-7c8530671cd1 req-46623484-1f2d-4d90-993c-46b3cc4f43d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:38.845513 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-add3703f-dbec-4356-b373-7c8530671cd1 req-46623484-1f2d-4d90-993c-46b3cc4f43d8 service neutron] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 910 time: 0.1364684
May 28 14:38:38.955025 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-add3703f-dbec-4356-b373-7c8530671cd1 req-409a7827-075f-4f61-9dd3-cf920bb27c62 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab HTTP/1.1" status: 200  len: 1002 time: 0.1017065
May 28 14:38:39.032980 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add3703f-dbec-4356-b373-7c8530671cd1 req-55479b38-4146-421d-9a66-74e7960070ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:39.034479 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-add3703f-dbec-4356-b373-7c8530671cd1 req-55479b38-4146-421d-9a66-74e7960070ab service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0682373
May 28 14:38:39.111126 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add3703f-dbec-4356-b373-7c8530671cd1 req-83e6d6db-9d55-4b0a-82d0-dbefb621d0e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:38:39.113034 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-add3703f-dbec-4356-b373-7c8530671cd1 req-83e6d6db-9d55-4b0a-82d0-dbefb621d0e2 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0714979
May 28 14:38:39.244329 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-add3703f-dbec-4356-b373-7c8530671cd1 req-d0b208bb-2008-4010-ace8-e19bf2fc6b55 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1242781
May 28 14:38:39.377146 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-add3703f-dbec-4356-b373-7c8530671cd1 req-58968eb9-8b26-4ad0-a62a-9a4e37a769f4 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1248674
May 28 14:38:58.032989 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:38:59.998557 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-33f557a3-8eef-471b-a4df-6c7c5b8e362e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:02.547059 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-165f5ec9-81de-4321-91bb-8893eef0e547 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:02.586631 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:03.740778 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:05.364378 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:13.522703 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:39:17.538916 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 req-d410902b-ec9b-4390-9e8a-8af1f4ed531e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:17.540400 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 req-d410902b-ec9b-4390-9e8a-8af1f4ed531e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0814610
May 28 14:39:17.590964 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-6ceb25ab-8a5b-435e-b6d4-1d4c264e2256 req-b5774ce2-b1d9-47dd-bc99-30b4da5c01e3 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0435596
May 28 14:39:18.773541 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 req-3db8f635-0d7d-407b-9dba-5bf1184f121a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:18.774988 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 req-3db8f635-0d7d-407b-9dba-5bf1184f121a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0805418
May 28 14:39:18.824761 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-cefeee4b-d0a6-4cda-91b1-413afb5517f0 req-087196f7-797f-44d2-a7e1-92856bb17eb4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0435770
May 28 14:39:20.009515 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9106421e-1041-40fc-97af-0d2c263f4cd5 req-78c356ae-69ec-4b74-9a2f-b6856d030eea tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:20.011485 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9106421e-1041-40fc-97af-0d2c263f4cd5 req-78c356ae-69ec-4b74-9a2f-b6856d030eea tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0786862
May 28 14:39:20.054633 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-9106421e-1041-40fc-97af-0d2c263f4cd5 req-e981ed95-fea2-4b3b-979b-1c07c8692965 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0376074
May 28 14:39:21.237886 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38a6660-d11c-4e25-851b-ff9cbcbe552f req-6e1d0041-9c4a-4190-91c8-4a44dbb659d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:21.239313 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c38a6660-d11c-4e25-851b-ff9cbcbe552f req-6e1d0041-9c4a-4190-91c8-4a44dbb659d7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0794704
May 28 14:39:21.282834 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c38a6660-d11c-4e25-851b-ff9cbcbe552f req-a5516661-6a5c-4f56-b1ba-f4707fb9a1e2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0371084
May 28 14:39:22.466560 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f32ddae-4c41-436c-bf37-69fd7b6d973d req-b92a8c50-3831-48e0-a2f7-9798b51f0632 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:22.467990 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7f32ddae-4c41-436c-bf37-69fd7b6d973d req-b92a8c50-3831-48e0-a2f7-9798b51f0632 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0812597
May 28 14:39:22.626880 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-7f32ddae-4c41-436c-bf37-69fd7b6d973d req-9861bcf8-34ca-4e9c-bae7-804a5fd89091 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1532185
May 28 14:39:23.813939 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 req-e29eaa36-d7ee-46af-9cb4-800555397e4e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:23.815464 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 req-e29eaa36-d7ee-46af-9cb4-800555397e4e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0850759
May 28 14:39:23.863705 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-12b1dbd3-9d49-4ac6-8be8-de8faaa19c57 req-c2d96df7-9fe3-41ef-a64d-60cba449f270 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0420983
May 28 14:39:25.048942 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 req-b8ff5043-3a75-4723-a89f-463723da2092 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:25.050379 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 req-b8ff5043-3a75-4723-a89f-463723da2092 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0811565
May 28 14:39:25.098005 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c95282fc-4c35-49e4-a05c-fbc5a4fda520 req-53ed6c68-1e8c-4034-b39d-b1c6f7d6c291 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418744
May 28 14:39:26.282927 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f97c49-1073-4cc4-9e3d-8a3926ea28af req-6896ffde-c19c-4c06-9b1d-b9c5303665ba tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:26.284479 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-92f97c49-1073-4cc4-9e3d-8a3926ea28af req-6896ffde-c19c-4c06-9b1d-b9c5303665ba tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0793912
May 28 14:39:26.330272 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-92f97c49-1073-4cc4-9e3d-8a3926ea28af req-ca54b6d9-f860-4906-846b-452112eac327 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401599
May 28 14:39:27.517188 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 req-71fe3b15-4130-4161-a64d-085866ef3d9a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:27.518718 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 req-71fe3b15-4130-4161-a64d-085866ef3d9a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0803308
May 28 14:39:27.564554 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b6d7c5ad-8602-4c80-8aa0-b7688c07ba88 req-d1ed0655-113b-4e65-99b3-46071346f231 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401790
May 28 14:39:27.997923 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:28.750259 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83403046-f1cc-4864-a55f-605bf64151b8 req-eef9f74c-06f7-4d1d-81be-90986f24d36f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:28.751737 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-83403046-f1cc-4864-a55f-605bf64151b8 req-eef9f74c-06f7-4d1d-81be-90986f24d36f tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0829902
May 28 14:39:28.795640 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-83403046-f1cc-4864-a55f-605bf64151b8 req-c0c39eb3-efa9-4219-acc3-58c6f6978abd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383310
May 28 14:39:29.289029 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da req-0e00897d-5e0a-4cfd-a04a-5718ff43b8a8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:29.290535 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da req-0e00897d-5e0a-4cfd-a04a-5718ff43b8a8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0801256
May 28 14:39:29.339266 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-b8867be1-f857-4c4a-b3cc-1c0ec9d3f4da req-acb626e6-1b89-4983-aed6-fe48de73251b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421469
May 28 14:39:29.392539 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-f0327741-5da9-4072-bb7a-316298111080 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:29.393931 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-f0327741-5da9-4072-bb7a-316298111080 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 1099 time: 0.0740507
May 28 14:39:29.526392 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-093dfd31-9af8-45bc-a840-0110d14ad267 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:29.527858 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-093dfd31-9af8-45bc-a840-0110d14ad267 service neutron] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 910 time: 0.1271536
May 28 14:39:29.631146 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-436f44ad-19e2-493f-8b0b-d7b2c05e6044 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab HTTP/1.1" status: 200  len: 1002 time: 0.0942950
May 28 14:39:29.695442 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-14d8c70e-fa3d-470d-b906-750f654a45b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:29.696785 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-14d8c70e-fa3d-470d-b906-750f654a45b5 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0595798
May 28 14:39:29.770954 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-c904e0eb-96c7-467d-a2ee-35b0427179be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:29.772536 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-c904e0eb-96c7-467d-a2ee-35b0427179be service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0687551
May 28 14:39:29.903147 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-9c84e0f0-91ce-4014-a362-6db8780d8ae3 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1230175
May 28 14:39:30.039023 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-75b7dbec-b15e-47cc-89f3-0b8f882c96f1 req-ef531978-886f-4930-aa19-8a6a16776727 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1292253
May 28 14:39:30.042980 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-07476424-99dd-4c99-836f-3855102e2afb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:30.534033 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 req-f441e8ba-0c2c-4ce0-aa36-f788d8fd7d50 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:30.535484 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 req-f441e8ba-0c2c-4ce0-aa36-f788d8fd7d50 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0871637
May 28 14:39:30.581102 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-59b745a9-cdc1-4193-9d99-e64bf3c2cb93 req-98331f10-b6d1-4452-af1a-5774cba95752 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397298
May 28 14:39:31.863861 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 req-fe802bf6-4d77-499c-a8e7-f2ed14a097fa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:31.865256 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 req-fe802bf6-4d77-499c-a8e7-f2ed14a097fa tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.1749902
May 28 14:39:31.911543 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-5278bec4-32a8-4c09-a6fc-6d5a35f9aa04 req-5bc34ae2-f033-40cc-a5ea-fb7f26d8b497 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403228
May 28 14:39:32.552064 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3f859bd5-af77-43cd-a32d-26c4d4291f26 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:32.597397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:33.751121 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:35.380472 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:39:39.530709 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-c7aa724e-0bd1-452f-98ad-dd86ce4102ef service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0683315
May 28 14:39:39.672280 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-b8a2a60c-31b2-49c8-a40e-21273e451f8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:39.673661 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-b8a2a60c-31b2-49c8-a40e-21273e451f8f service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 1099 time: 0.0753407
May 28 14:39:39.816383 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-3fa45989-8dec-429f-88cc-5e0702d394f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:39.817825 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-3fa45989-8dec-429f-88cc-5e0702d394f1 service neutron] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 910 time: 0.1238508
May 28 14:39:39.921126 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-57a3ab53-a969-4449-9854-8b98568aae61 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab HTTP/1.1" status: 200  len: 1002 time: 0.0964947
May 28 14:39:39.982638 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-30df76df-f14c-4825-8f07-f535dc5f00a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:39.984165 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-30df76df-f14c-4825-8f07-f535dc5f00a8 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0563362
May 28 14:39:40.067346 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-5d6e2a84-3680-4a46-84a1-88644e8de7a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:39:40.068846 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-5d6e2a84-3680-4a46-84a1-88644e8de7a6 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0764565
May 28 14:39:40.294069 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-80e37314-a966-4d62-adbd-606c4c627ba0 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2178259
May 28 14:39:40.427180 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a059bcba-fd89-48df-bc76-b259c1e0b451 req-bd90aef1-8072-4046-a9fc-9c597e8863c1 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1241786
May 28 14:39:50.522230 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:39:57.997207 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:00.002335 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b89a84d4-f842-4f96-9188-f605e6791d24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:02.533737 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:02.567994 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-d33600cd-0e66-417a-9a9a-76136f5e1f8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:03.779367 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:05.356582 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:27.521590 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:40:28.047273 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:30.007518 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f97a1874-ce16-4de9-936f-30663b3e6ce9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:32.572770 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:32.595468 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-18ed9984-8feb-44bf-9a83-dc6195f62e14 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:33.755968 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:35.373123 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:35.885253 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 req-0270b343-ea57-44d0-a669-32517dba9be7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:35.886708 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 req-0270b343-ea57-44d0-a669-32517dba9be7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0812829
May 28 14:40:35.933049 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0fe21bf2-c54e-4a6a-a11a-6c82b08f4c38 req-e0fbb67c-9f49-4cec-8ea4-81aa39fbb1ac tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400159
May 28 14:40:37.126848 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 req-897e61a4-eef0-452a-b517-caf302dfe462 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:37.128233 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 req-897e61a4-eef0-452a-b517-caf302dfe462 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0850239
May 28 14:40:37.172214 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-27c0e9e0-f0fc-49ca-8ae2-77497bc176b8 req-26b2e2d5-2035-4662-9034-bd6fe22605a9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383496
May 28 14:40:38.134713 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-bed74348-0cda-497b-9edd-d3f1a2899545 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:38.136123 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-bed74348-0cda-497b-9edd-d3f1a2899545 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0788801
May 28 14:40:38.286368 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Deleting port c41d8419-2408-4487-95f1-5b6ce2ba8dab {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:40:38.286703 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:38.375157 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 req-e0545686-1faa-46c7-b3e0-f54db8bc1358 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:38.376696 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 req-e0545686-1faa-46c7-b3e0-f54db8bc1358 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 946 time: 0.0809252
May 28 14:40:38.425114 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] For port c41d8419-2408-4487-95f1-5b6ce2ba8dab, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=c41d8419-2408-4487-95f1-5b6ce2ba8dab,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:40:38.425367 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:38.426353 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-35bf9b7b-0fe2-45ae-80b9-97be2099efc9 req-de174966-d223-4988-946d-9229c645592b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0433271
May 28 14:40:38.715842 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:38.716212 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:38.716525 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.l3_db [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Floating IP 9cfaadb4-78ab-49d7-8a47-671c0eeaac46 disassociated. External IP: 172.27.3.105, port: c41d8419-2408-4487-95f1-5b6ce2ba8dab.
May 28 14:40:38.716857 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling delete_port for c41d8419-2408-4487-95f1-5b6ce2ba8dab owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:40:38.916087 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:38.921860 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-3c79b818-2dc2-413b-812b-a39f209fd3cb tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:38.971437 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event deleted for resources: {'Port': ['ID=c41d8419-2408-4487-95f1-5b6ce2ba8dab,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:38.981715 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.982096 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.982475 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.982839 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.983196 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.983583 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.983932 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.984312 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.984667 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.985022 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.990768 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:38.990768 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:39.037813 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:39.166442 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Router 70a9e813-5550-4032-8b40-07e33a0a7066 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:40:39.462007 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:40:39.471519 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] Sync routers for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:40:39.483236 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:40:39.483959 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2563580>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:40:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:40:39.569955 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] No DVR routers for this DVR port c41d8419-2408-4487-95f1-5b6ce2ba8dab on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:40:39.576331 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:39.578906 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'name': 'network-vif-deleted', 'tag': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:40:39.591865 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-8aed125d-703a-4720-aeab-1d1704b6d862 req-8a987c64-b0f0-4348-815b-4ecdbc247dc9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 210 time: 0.0577478
May 28 14:40:39.626685 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c47c54c-f1cc-46f3-9e0f-5868ae50ba46', 'name': 'network-vif-deleted', 'tag': 'c41d8419-2408-4487-95f1-5b6ce2ba8dab', 'status': 'completed', 'code': 200}
May 28 14:40:39.663585 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:40:39.665618 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bb01af7b-268c-4d99-bdfd-a9c219d11312 req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "DELETE /v2.0/ports/c41d8419-2408-4487-95f1-5b6ce2ba8dab HTTP/1.1" status: 204  len: 173 time: 1.5238438
May 28 14:40:40.002046 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2563580>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:40:40.006388 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] Checking router: 70a9e813-5550-4032-8b40-07e33a0a7066 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:40:40.014392 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:40:40.014981 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2563580>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:40:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:40:40.194124 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:40:40.510542 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2563580>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:40:40.514421 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3126f6b3-48df-4646-8000-c6b3e390d937 None None] The sync data for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi is: [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:40:40.716974 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f72c1fd-aad2-4f28-8e76-bcf668f7405a None None] New status for floating IP 9cfaadb4-78ab-49d7-8a47-671c0eeaac46: DOWN {{(pid=92696) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:40:40.759785 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-e8e50f35-512d-4c9c-b9de-f5315480cc42 req-58129b02-ee52-4583-8c4c-c5b52df432b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Synchronizing usage tracker for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:40:40.848623 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-e8e50f35-512d-4c9c-b9de-f5315480cc42 req-58129b02-ee52-4583-8c4c-c5b52df432b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Unset dirty status for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:40:40.850466 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-e8e50f35-512d-4c9c-b9de-f5315480cc42 req-58129b02-ee52-4583-8c4c-c5b52df432b9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=5c47c54c-f1cc-46f3-9e0f-5868ae50ba46 HTTP/1.1" status: 200  len: 210 time: 0.1330993
May 28 14:40:42.059698 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41136) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:40:42.062943 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c41d8419-2408-4487-95f1-5b6ce2ba8dab no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:40:42.129902 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:42.136377 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: c41d8419-2408-4487-95f1-5b6ce2ba8dab {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:40:42.136733 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device c41d8419-2408-4487-95f1-5b6ce2ba8dab not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:40:42.158164 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:42.304017 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:42.308050 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-27fca78c-1192-4acc-b34d-f4d430230a36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:42.322092 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:42.330926 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.331302 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.331703 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.332062 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.332415 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.332767 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.333119 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.333468 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.333815 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.334163 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.334509 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.334884 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:40:42.338014 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:42.406171 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:42.407220 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-78deb14f-69d9-4940-9f0f-ee032094b285 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /v2.0/security-groups/39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14 HTTP/1.1" status: 204  len: 168 time: 0.3464892
May 28 14:40:42.410333 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41140) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:40:42.426805 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.api.v2.resource [None req-576bcbfc-20f5-4dcd-b0a1-8dfba8c22a33 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] show failed (client error): The resource could not be found.
May 28 14:40:42.427837 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-576bcbfc-20f5-4dcd-b0a1-8dfba8c22a33 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups/39400bc7-cd54-4e2d-9a11-fa7cd6d8fd14 HTTP/1.1" status: 404  len: 347 time: 0.0165961
May 28 14:40:42.430638 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41144) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:40:42.649339 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Deleting port 503f4aaf-a37f-4169-856a-e1dd7b3d6787 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:40:42.649682 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:42.768106 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:42.768450 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:42.893394 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling delete_port for 503f4aaf-a37f-4169-856a-e1dd7b3d6787 owned by network:floatingip {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:40:43.075650 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:43.079336 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ec074cd7-60e4-437d-bef8-cbe23b521959 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:43.124543 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event deleted for resources: {'Port': ['ID=503f4aaf-a37f-4169-856a-e1dd7b3d6787,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:43.156534 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:43.218017 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:43.292515 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:43.293672 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-04081108-d774-4f7d-8c42-929bfa165041 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /v2.0/floatingips/9cfaadb4-78ab-49d7-8a47-671c0eeaac46 HTTP/1.1" status: 204  len: 168 time: 0.8621843
May 28 14:40:43.764893 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41150) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:40:43.770306 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1910356893', 'description': 'tempest-description--577145396'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:40:43.776251 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:40:43.780357 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:security_group and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:40:43.783215 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:40:43.789460 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:40:43.875771 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:43.896041 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:40:43.899923 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:security_group_rule and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:40:43.902715 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:40:43.908353 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:40:43.979651 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.086925 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.090907 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-900eb025-424b-4891-815a-e8ee4ff6cfef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:44.133077 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b638f87d-53ec-43ad-b81f-a56cdefe318d,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:44.136047 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:44.201479 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.202774 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-63653c64-14b0-45b0-877d-6c55b7cc1558 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4368954
May 28 14:40:44.205539 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41154) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:40:44.211239 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'security_group_rule': {'security_group_id': 'b638f87d-53ec-43ad-b81f-a56cdefe318d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:40:44.217253 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:40:44.221144 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:security_group_rule and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:40:44.224738 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:40:44.230413 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:40:44.316199 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.381329 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.487101 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.489585 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8cbbea3f-ad0f-4d04-896f-f4ab50d3519a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:44.512905 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e53659c4-db01-4703-b6e4-843da61cea7d,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:44.517233 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:44.601199 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.602436 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-d7a8c41a-1603-4bdc-b9c1-ecd0796ca41c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3954039
May 28 14:40:44.605111 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41158) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:40:44.610338 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'security_group_rule': {'security_group_id': 'b638f87d-53ec-43ad-b81f-a56cdefe318d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:40:44.616251 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:40:44.620267 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:security_group_rule and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:40:44.623071 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:40:44.629188 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:40:44.714985 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.776159 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.898943 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673159'] for security_group_rule, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:44.901114 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-124f6168-b671-4541-a2cb-7b6c99c3475e tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:44.926328 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4b40856a-f376-4a3e-b551-c7412745e3b7,revision_number=0']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:44.930811 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:45.012858 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:45.014031 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-d668d785-d2ce-4092-a577-f6a9fc00776d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4079795
May 28 14:40:45.017028 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41162) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:40:45.022054 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'floatingip': {'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:40:45.028031 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:40:45.031822 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Usage tracker for resource:floatingip and tenant:61d5abfd60c747b5ad4bdeb820132545 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:40:45.034909 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:40:45.040719 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:40:45.121785 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:45.259002 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:45.484367 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_common [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Allocated IP 172.27.3.51 (f203e1e9-7403-4723-8925-7d733bca2c40/f0cd2108-42a0-4380-970f-9928591eb252/f4bdd294-0aeb-4eff-84ea-5002ea3b488e) {{(pid=92694) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:40:45.629880 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for port, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:45.716090 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:45.719836 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-380fc24d-49aa-4dd0-a341-1aba75529444 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:45.785587 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Network f203e1e9-7403-4723-8925-7d733bca2c40 is already hosted by enough agents. {{(pid=92694) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:40:45.788438 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.base_scheduler [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources bound (agent type, host, resource id):  {{(pid=92694) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:40:45.791841 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Received port after_create {{(pid=92694) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:40:45.820842 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'Port': ['ID=f4bdd294-0aeb-4eff-84ea-5002ea3b488e,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:45.826799 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:45.872898 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:46.020298 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:46.226260 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for port, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:46.281367 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3422850'] for port, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:46.285229 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-608745ab-aedb-486f-b6a7-4b80fe69da91 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:46.390575 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'Port': ['ID=f4bdd294-0aeb-4eff-84ea-5002ea3b488e,revision_number=2']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:46.394692 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:46.403028 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:46.515297 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:46.516565 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-d1e739fc-ba0a-4672-a68b-a8bc6c4ded4b tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.4986110
May 28 14:40:46.739955 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-3cf2282d-b8ea-4f2c-925f-1513bba74cd8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?name=tempest-securitygroup--1910356893&fields=id&tenant_id=61d5abfd60c747b5ad4bdeb820132545 HTTP/1.1" status: 200  len: 267 time: 0.0447052
May 28 14:40:46.891993 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-caa540ee-71e3-41ce-bb7f-d85fb0a4b2f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:46.893448 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-caa540ee-71e3-41ce-bb7f-d85fb0a4b2f1 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 809 time: 0.1465969
May 28 14:40:46.908279 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-2e827972-97d3-4913-93c8-5e319f1725bd tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/quotas/61d5abfd60c747b5ad4bdeb820132545 HTTP/1.1" status: 200  len: 375 time: 0.0092845
May 28 14:40:46.994909 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-1221cac4-6a36-422c-9e18-503764eeddc8 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0805953
May 28 14:40:47.110380 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-94351f95-8d1e-4890-8bed-b34194ef85d5 service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92695) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:40:47.111515 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-94351f95-8d1e-4890-8bed-b34194ef85d5 service neutron] 10.222.0.59 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1047111
May 28 14:40:47.242683 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-3ab58b98-c143-4acd-a27f-2a51dc1478e0 service neutron] 10.222.0.59 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1246576
May 28 14:40:47.373892 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-b663e84c-5ec8-466e-afe8-86a707757569 service neutron] 10.222.0.59 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252539
May 28 14:40:47.655904 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-c93b67bb-30ff-4b63-a606-0da43f51d375 req-424f2004-ac32-4284-9091-d81b870ddf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Synchronizing usage tracker for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:40:47.744338 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-c93b67bb-30ff-4b63-a606-0da43f51d375 req-424f2004-ac32-4284-9091-d81b870ddf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Unset dirty status for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:40:47.745543 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-c93b67bb-30ff-4b63-a606-0da43f51d375 req-424f2004-ac32-4284-9091-d81b870ddf9d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 210 time: 0.1330569
May 28 14:40:48.840970 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d4d01dd8-945a-459e-ac11-e5e3a81f1c72 req-083da4b1-d9d8-4c22-adfe-b51651bf5349 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 210 time: 0.0437353
May 28 14:40:49.937713 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-9e8cb4f4-afcf-4767-9afa-eda17f64e0af req-f78f815e-80cd-44c4-9de2-2246402c5d3a tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 210 time: 0.0445597
May 28 14:40:51.037891 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5b6c7146-81af-4930-a41c-ce866c82fdc0 req-80c5f2f5-f34d-4956-b116-7c6d78f72473 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 210 time: 0.0475397
May 28 14:40:52.190840 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-7ea4229d-4cd3-453c-bf13-9a40d8da9bff req-2e1a1b01-9718-449d-81d3-b157d6571771 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 210 time: 0.0449786
May 28 14:40:53.340844 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-a52ec0fa-e9ae-4d20-9899-703e32a1fa9d req-d13f8bc4-0df6-4e2e-9260-6b9533d48551 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 210 time: 0.0427375
May 28 14:40:54.047101 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-6c6e4749-4efb-45fc-90a6-98693090f4f4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:54.048514 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-6c6e4749-4efb-45fc-90a6-98693090f4f4 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 809 time: 0.1922512
May 28 14:40:54.097981 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-8204026a-3793-49e4-b0da-6abdcbccf6ae tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=61d5abfd60c747b5ad4bdeb820132545 HTTP/1.1" status: 200  len: 380 time: 0.0404301
May 28 14:40:54.109010 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'port': {'device_id': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'admin_state_up': True, 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'security_groups': ['b638f87d-53ec-43ad-b81f-a56cdefe318d']}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:40:54.244811 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:40:54.254591 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:40:54.355522 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Made reservation on behalf of 61d5abfd60c747b5ad4bdeb820132545 for: {'port': 1} {{(pid=92695) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 28 14:40:54.359105 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:54.492493 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-ea5354af-a6f7-4e3c-8d62-88f1d2d35434 req-2b669c7b-c28f-4f26-974a-a12c2459e080 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 210 time: 0.0431058
May 28 14:40:54.531087 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.db_base_plugin_common [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Allocated IP 172.20.0.4 (d07aad82-58f0-48c7-bdbc-4ebfe5f698dc/097b2b8c-d0d5-4b10-a710-a27ac2380514/10309ae3-44cf-4796-91db-63f78b0c6d94) {{(pid=92695) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 28 14:40:54.713475 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for port, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:54.728858 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Transition to ACTIVE for port object 10309ae3-44cf-4796-91db-63f78b0c6d94 will not be triggered until provisioned by entity DHCP. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:40:54.824447 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8777742261971', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:54.830609 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-417b15af-f259-4fff-939d-ada8171d6cf4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:55.008081 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc is already hosted by enough agents. {{(pid=92695) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 28 14:40:55.011151 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.base_scheduler [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Resources bound (agent type, host, resource id):  {{(pid=92695) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 28 14:40:55.015159 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Received port after_create {{(pid=92695) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 28 14:40:55.057381 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event updated for resources: {'Port': ['ID=10309ae3-44cf-4796-91db-63f78b0c6d94,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:55.060574 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:55.091923 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:55.092553 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:55.184897 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-01b72248-5de3-4807-9356-c5c06a500cc7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0793970
May 28 14:40:55.196641 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.v2.base [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Request body: {'port': {'device_id': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79128'}} {{(pid=92695) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:40:55.286732 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-62eeb756-a4cd-4a8f-86a7-7090955ea6a2 None None] Provisioning for port 10309ae3-44cf-4796-91db-63f78b0c6d94 completed by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:40:55.292132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-62eeb756-a4cd-4a8f-86a7-7090955ea6a2 None None] Provisioning complete for port 10309ae3-44cf-4796-91db-63f78b0c6d94 triggered by entity DHCP. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:40:55.292504 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-62eeb756-a4cd-4a8f-86a7-7090955ea6a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:55.307450 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:55.347760 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-62eeb756-a4cd-4a8f-86a7-7090955ea6a2 None None] Port 10309ae3-44cf-4796-91db-63f78b0c6d94 cannot update to ACTIVE because it is not bound. {{(pid=92696) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 28 14:40:55.697533 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 10309ae3-44cf-4796-91db-63f78b0c6d94 {{(pid=92695) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:40:55.705655 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:55.726405 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.provisioning_blocks [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Transition to ACTIVE for port object 10309ae3-44cf-4796-91db-63f78b0c6d94 will not be triggered until provisioned by entity L2. {{(pid=92695) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 28 14:40:55.743842 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726b36e6-29a3-47c8-89cc-b7f024e53941 req-a740222d-ec1c-49e3-843e-649fd5e029b6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:55.744535 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-726b36e6-29a3-47c8-89cc-b7f024e53941 req-a740222d-ec1c-49e3-843e-649fd5e029b6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Synchronizing usage tracker for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:40:55.806912 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:55.810834 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-70ff2614-d285-4fbf-8ccf-f48df94fbb07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:55.915921 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-726b36e6-29a3-47c8-89cc-b7f024e53941 req-a740222d-ec1c-49e3-843e-649fd5e029b6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Unset dirty status for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:40:55.917006 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-726b36e6-29a3-47c8-89cc-b7f024e53941 req-a740222d-ec1c-49e3-843e-649fd5e029b6 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 931 time: 0.3179920
May 28 14:40:55.960898 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Pushing event updated for resources: {'Port': ['ID=10309ae3-44cf-4796-91db-63f78b0c6d94,revision_number=2']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:55.990074 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:56.059955 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-726b36e6-29a3-47c8-89cc-b7f024e53941 req-57cd3d13-ebf1-4386-b2f6-7434e5d160ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1346819
May 28 14:40:56.090070 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Attempting to bind port 10309ae3-44cf-4796-91db-63f78b0c6d94 on host hv-cinder-79128 for vnic_type normal with profile  {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 28 14:40:56.090398 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Attempting to bind port 10309ae3-44cf-4796-91db-63f78b0c6d94 by drivers openvswitch,hyperv on host hv-cinder-79128 at level 0 using segments [{'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 28 14:40:56.090719 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Attempting to bind port 10309ae3-44cf-4796-91db-63f78b0c6d94 on network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:40:56.095297 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Port 10309ae3-44cf-4796-91db-63f78b0c6d94 on network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79128 {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 28 14:40:56.095636 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Attempting to bind port 10309ae3-44cf-4796-91db-63f78b0c6d94 on network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 28 14:40:56.100682 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Checking agent: {'id': 'af0e9fb4-f2eb-42ed-b24d-b45af018099b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79128', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'started_at': datetime.datetime(2021, 5, 28, 14, 19, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 28, 14, 40, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 28 14:40:56.101008 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Checking segment: {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92695) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 28 14:40:56.101377 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Bound using segment: {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'} {{(pid=92695) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 28 14:40:56.101788 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.managers [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Bound port: 10309ae3-44cf-4796-91db-63f78b0c6d94, host: hv-cinder-79128, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc'}}] {{(pid=92695) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 28 14:40:56.102122 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:56.188639 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] For port 10309ae3-44cf-4796-91db-63f78b0c6d94, host hv-cinder-79128, cleared binding levels {{(pid=92695) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 28 14:40:56.191642 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] For port 10309ae3-44cf-4796-91db-63f78b0c6d94, host hv-cinder-79128, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=10309ae3-44cf-4796-91db-63f78b0c6d94,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92695) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 28 14:40:56.258432 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1697884'] for port, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:56.262137 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-f151f550-6884-4eb3-8067-e0e37b8fe471 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:40:56.323106 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:56.323745 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:56.325096 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] 10.222.0.90 "PUT /v2.0/ports/10309ae3-44cf-4796-91db-63f78b0c6d94 HTTP/1.1" status: 200  len: 1093 time: 1.1325343
May 28 14:40:56.325613 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'tag': '10309ae3-44cf-4796-91db-63f78b0c6d94'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:40:56.345092 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Pushing event updated for resources: {'Port': ['ID=10309ae3-44cf-4796-91db-63f78b0c6d94,revision_number=3']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:40:56.348404 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a6ddb137-dd42-4458-aafe-e41795cc4c14 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:40:56.374670 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'tag': '10309ae3-44cf-4796-91db-63f78b0c6d94', 'status': 'completed', 'code': 200}
May 28 14:40:56.471828 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-3b468d5a-08ae-4299-9f72-7f369eeea644 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:56.473296 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-3b468d5a-08ae-4299-9f72-7f369eeea644 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 1096 time: 0.0777912
May 28 14:40:56.616995 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-57247ddb-6155-408b-a00e-f0d260fa7ffa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:56.618890 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-57247ddb-6155-408b-a00e-f0d260fa7ffa service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=61d5abfd60c747b5ad4bdeb820132545&shared=False HTTP/1.1" status: 200  len: 910 time: 0.1369495
May 28 14:40:56.753982 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-71596e24-bc7e-4b58-8419-7744f8ed2142 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:56.755424 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b3a0f187-0826-422c-8a3c-aa958e580e52 req-71596e24-bc7e-4b58-8419-7744f8ed2142 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1305151
May 28 14:40:56.861132 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-92593b74-ba56-4286-9fc8-46a90936d2a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:56.862525 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-92593b74-ba56-4286-9fc8-46a90936d2a7 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 1096 time: 0.0703757
May 28 14:40:56.933289 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-5e4a2a01-d8de-4e4e-b10b-9c9f9d3363b4 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=10309ae3-44cf-4796-91db-63f78b0c6d94 HTTP/1.1" status: 200  len: 217 time: 0.0634041
May 28 14:40:56.995586 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-b81cb26f-cf3d-41b6-b479-33cac92e3cd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:56.997005 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-b81cb26f-cf3d-41b6-b479-33cac92e3cd4 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0572078
May 28 14:40:57.235374 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-f3270ad1-3947-4726-b8b1-f6d6f6bcf377 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:57.236999 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-f3270ad1-3947-4726-b8b1-f6d6f6bcf377 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2337618
May 28 14:40:57.329123 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb3b100-72e4-432f-97ee-615b6ecaf151 req-c3acd9e8-ce4f-47d1-a3fc-39ea6847bc03 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:57.330555 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1cb3b100-72e4-432f-97ee-615b6ecaf151 req-c3acd9e8-ce4f-47d1-a3fc-39ea6847bc03 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 943 time: 0.1622763
May 28 14:40:57.409964 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-1cb3b100-72e4-432f-97ee-615b6ecaf151 req-6fbe68bd-156f-4420-90bd-c838441fda49 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0720260
May 28 14:40:57.415270 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-22def8b6-a84b-4b15-912b-23aa78de277f service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1703649
May 28 14:40:57.549346 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-52a95255-081b-4a99-a63b-dd9cd9ece63b req-aef028d6-3cf6-4b9f-81d5-c1b826114c4c service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1272640
May 28 14:40:58.081387 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:40:58.593622 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb9d720-8172-485f-90ef-3c499ce7286d req-8ba53afd-7cc1-4327-9af5-dc63d08106ca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:58.595105 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3eb9d720-8172-485f-90ef-3c499ce7286d req-8ba53afd-7cc1-4327-9af5-dc63d08106ca tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 943 time: 0.0800183
May 28 14:40:58.641883 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-3eb9d720-8172-485f-90ef-3c499ce7286d req-469b39d5-a307-49f3-9d07-b559919830e9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Synchronizing usage tracker for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:security_group {{(pid=92694) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:40:58.755660 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [req-3eb9d720-8172-485f-90ef-3c499ce7286d req-469b39d5-a307-49f3-9d07-b559919830e9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Unset dirty status for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:security_group {{(pid=92694) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:40:58.756828 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-3eb9d720-8172-485f-90ef-3c499ce7286d req-469b39d5-a307-49f3-9d07-b559919830e9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1562085
May 28 14:40:59.947923 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b555e2-bef2-4a09-b5b8-a37373215564 req-62a39331-1176-4e08-bb08-978ff1e1e641 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:40:59.949423 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c4b555e2-bef2-4a09-b5b8-a37373215564 req-62a39331-1176-4e08-bb08-978ff1e1e641 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 943 time: 0.0839388
May 28 14:40:59.996850 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-c4b555e2-bef2-4a09-b5b8-a37373215564 req-a64ea645-6455-4a57-b737-fa62191d64ee tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415401
May 28 14:41:00.041379 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-a37cd33a-c1ae-45df-bd58-787b6ebd1f91 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:00.136307 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 10309ae3-44cf-4796-91db-63f78b0c6d94 details requested by agent hyperv_hv-cinder-79128 with host hv-cinder-79128 {{(pid=92696) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 28 14:41:00.267020 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 10309ae3-44cf-4796-91db-63f78b0c6d94, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=10309ae3-44cf-4796-91db-63f78b0c6d94,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:41:00.280362 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Returning: {'device': '10309ae3-44cf-4796-91db-63f78b0c6d94', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'port_id': '10309ae3-44cf-4796-91db-63f78b0c6d94', 'mac_address': 'fa:16:3e:85:46:cd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 851, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92696) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 28 14:41:00.337662 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:00.354591 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 10309ae3-44cf-4796-91db-63f78b0c6d94 {{(pid=92696) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 28 14:41:00.369955 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 10309ae3-44cf-4796-91db-63f78b0c6d94, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=10309ae3-44cf-4796-91db-63f78b0c6d94,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:41:00.441128 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:00.443745 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-91ae324e-a80c-46f1-861e-7eb4d28c3ab3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:41:00.511989 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=10309ae3-44cf-4796-91db-63f78b0c6d94,revision_number=4']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:41:00.519169 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.519508 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.519864 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.520189 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.520529 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.520831 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.521147 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.521464 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.521778 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.522092 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.522409 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.522719 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:41:00.526969 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:41:00.827629 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] get_ports_and_sgs() called for port_ids ['10309ae3-44cf-4796-91db-63f78b0c6d94'] {{(pid=92696) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 28 14:41:01.183759 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0720d16c-f972-4939-bcea-51d647d426fc req-edbbe5f2-9c1b-442b-826c-362d56621c0c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:01.185676 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0720d16c-f972-4939-bcea-51d647d426fc req-edbbe5f2-9c1b-442b-826c-362d56621c0c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 944 time: 0.0813766
May 28 14:41:01.229735 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-0720d16c-f972-4939-bcea-51d647d426fc req-8e8b7b27-60ef-4073-a21a-d5139cb3d5fe tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0384581
May 28 14:41:02.168124 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 10309ae3-44cf-4796-91db-63f78b0c6d94 up at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 28 14:41:02.298883 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning for port 10309ae3-44cf-4796-91db-63f78b0c6d94 completed by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 28 14:41:02.304286 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.provisioning_blocks [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Provisioning complete for port 10309ae3-44cf-4796-91db-63f78b0c6d94 triggered by entity L2. {{(pid=92696) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 28 14:41:02.304672 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8325407'] for port, provisioning_complete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:02.417539 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91642a06-99b8-429c-8ae2-24a6131dadca req-f4bcd397-beda-44b7-b14d-86bb805af03d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:02.418926 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-91642a06-99b8-429c-8ae2-24a6131dadca req-f4bcd397-beda-44b7-b14d-86bb805af03d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 944 time: 0.0842209
May 28 14:41:02.423715 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7961641'] for port, before_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:02.465928 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-91642a06-99b8-429c-8ae2-24a6131dadca req-19a334b5-7e7d-4704-af96-13caa28a1c03 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408239
May 28 14:41:02.470277 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10309ae3-44cf-4796-91db-63f78b0c6d94'}] {{(pid=92696) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:41:02.483077 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] For port 10309ae3-44cf-4796-91db-63f78b0c6d94, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=10309ae3-44cf-4796-91db-63f78b0c6d94,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:41:02.549308 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:02.578325 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-da68c65e-a019-4843-b6a4-812cdd2c5f7e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:02.582264 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8777742695572', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8777742261989', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8777742263062'] for port, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:02.582264 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-8ef1f7e5-d137-454f-a309-118d869061bb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:41:02.649259 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Pushing event updated for resources: {'Port': ['ID=10309ae3-44cf-4796-91db-63f78b0c6d94,revision_number=5']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:41:02.652949 dv-cinder-791281-3-iscsi neutron-server[92696]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10309ae3-44cf-4796-91db-63f78b0c6d94', 'code': 200}
May 28 14:41:02.653629 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:41:03.056140 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ead35db-0adc-4af5-945c-3c7ebb29a917 req-a867e5bc-60f8-437c-a4f8-1a512228f91f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:03.057593 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4ead35db-0adc-4af5-945c-3c7ebb29a917 req-a867e5bc-60f8-437c-a4f8-1a512228f91f service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 1098 time: 0.0693769
May 28 14:41:03.101118 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-4ead35db-0adc-4af5-945c-3c7ebb29a917 req-25960779-7782-4b4f-a9ba-770714f65fc5 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0367837
May 28 14:41:03.646135 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76422f8e-2de7-46ad-9e87-54eca982d2e0 req-e227e76c-0cf7-4288-a1b3-2b3e8af2e147 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:03.647574 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76422f8e-2de7-46ad-9e87-54eca982d2e0 req-e227e76c-0cf7-4288-a1b3-2b3e8af2e147 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 945 time: 0.0786724
May 28 14:41:03.693672 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-76422f8e-2de7-46ad-9e87-54eca982d2e0 req-ab9e96b1-ad28-447f-8f13-cafcffec7feb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391977
May 28 14:41:03.784132 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:04.524033 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:41:04.885176 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e29913-2c36-4155-86a2-38ad8f5269f1 req-30309bd1-496c-42f2-bfa3-be94acd6ba61 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:04.886629 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-28e29913-2c36-4155-86a2-38ad8f5269f1 req-30309bd1-496c-42f2-bfa3-be94acd6ba61 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 945 time: 0.0858614
May 28 14:41:04.930796 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-28e29913-2c36-4155-86a2-38ad8f5269f1 req-d57768ea-de7b-428c-84aa-8d29e55133f2 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0384274
May 28 14:41:05.124376 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbd5359-a2cf-4b22-bc2a-637c0d00815e req-7f055344-6512-4682-93f2-a3e1d2c6978c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:05.125730 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bfbd5359-a2cf-4b22-bc2a-637c0d00815e req-7f055344-6512-4682-93f2-a3e1d2c6978c tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 945 time: 0.0949576
May 28 14:41:05.134203 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41244) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:41:05.139349 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.v2.base [None req-e2fc40df-a394-4fc4-9b6d-243dfe2afddf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Request body: {'floatingip': {'port_id': '10309ae3-44cf-4796-91db-63f78b0c6d94'}} {{(pid=92694) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 28 14:41:05.219273 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e2fc40df-a394-4fc4-9b6d-243dfe2afddf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, before_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:05.395257 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:05.937991 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e2fc40df-a394-4fc4-9b6d-243dfe2afddf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:06.017943 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e2fc40df-a394-4fc4-9b6d-243dfe2afddf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:06.192008 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.db.l3_db [None req-e2fc40df-a394-4fc4-9b6d-243dfe2afddf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Floating IP ac83117f-2968-42c5-94e7-b600d22cceec associated. External IP: 172.27.3.51, port: 10309ae3-44cf-4796-91db-63f78b0c6d94.
May 28 14:41:06.553662 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e2fc40df-a394-4fc4-9b6d-243dfe2afddf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Router 70a9e813-5550-4032-8b40-07e33a0a7066 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:41:06.733696 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e2fc40df-a394-4fc4-9b6d-243dfe2afddf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:41:06.738711 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e2fc40df-a394-4fc4-9b6d-243dfe2afddf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:06.743673 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] Sync routers for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:41:06.753115 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:41:06.755362 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2771730>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:41:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:41:06.793698 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e2fc40df-a394-4fc4-9b6d-243dfe2afddf tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "PUT /v2.0/floatingips/ac83117f-2968-42c5-94e7-b600d22cceec HTTP/1.1" status: 200  len: 990 time: 1.6583958
May 28 14:41:06.794368 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'tag': '10309ae3-44cf-4796-91db-63f78b0c6d94'}] {{(pid=92694) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:41:06.915362 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'tag': '10309ae3-44cf-4796-91db-63f78b0c6d94', 'status': 'completed', 'code': 200}
May 28 14:41:06.941471 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:41:07.010664 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-fd3ee465-1c8f-4d5e-b028-9153534d3468 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:07.012203 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-fd3ee465-1c8f-4d5e-b028-9153534d3468 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 1098 time: 0.0735042
May 28 14:41:07.156527 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-618579d8-6cfe-451f-ba93-85b12c1588f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:07.157970 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-618579d8-6cfe-451f-ba93-85b12c1588f6 service neutron] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 910 time: 0.1392934
May 28 14:41:07.271896 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-474241d5-083c-4377-ba86-0f566721cec8 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=10309ae3-44cf-4796-91db-63f78b0c6d94 HTTP/1.1" status: 200  len: 998 time: 0.1063740
May 28 14:41:07.307067 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2771730>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'ac83117f-2968-42c5-94e7-b600d22cceec', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'floating_ip_address': '172.27.3.51', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'port_id': '10309ae3-44cf-4796-91db-63f78b0c6d94', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 641, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'mac_address': 'fa:16:3e:85:46:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:40:45Z', 'updated_at': '2021-05-28T14:41:05Z', 'revision_number': 1, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:41:07.314959 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] Checking router: 70a9e813-5550-4032-8b40-07e33a0a7066 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:41:07.319497 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:41:07.320129 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2771730>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:41:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:41:07.335006 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-68553a15-616f-4b32-a75a-c437ef245a61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:07.338056 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-68553a15-616f-4b32-a75a-c437ef245a61 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0577903
May 28 14:41:07.417562 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-4357224f-28db-44f4-b42c-ec2e7c9bc780 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:07.418942 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-4357224f-28db-44f4-b42c-ec2e7c9bc780 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0749094
May 28 14:41:07.499266 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:41:07.557450 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-d00eb34b-29c8-4586-8dc7-f4f834771ff6 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1317320
May 28 14:41:07.803920 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-cf8b302c-e28b-4d18-8771-41e73aa79eef req-37ead251-7726-492c-8448-89874203badf service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2400227
May 28 14:41:07.889684 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2771730>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'ac83117f-2968-42c5-94e7-b600d22cceec', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'floating_ip_address': '172.27.3.51', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'port_id': '10309ae3-44cf-4796-91db-63f78b0c6d94', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 641, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'mac_address': 'fa:16:3e:85:46:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:40:45Z', 'updated_at': '2021-05-28T14:41:05Z', 'revision_number': 1, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:41:07.893533 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6aa10b16-d4cf-45cb-b75d-8f4f88850b2d None None] The sync data for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi is: [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_floatingips': [{'id': 'ac83117f-2968-42c5-94e7-b600d22cceec', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'floating_ip_address': '172.27.3.51', 'floating_network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'router_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'port_id': '10309ae3-44cf-4796-91db-63f78b0c6d94', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 641, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'mac_address': 'fa:16:3e:85:46:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-28T14:40:45Z', 'updated_at': '2021-05-28T14:41:05Z', 'revision_number': 1, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:41:08.079047 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ae31916-f8f2-480c-814e-9cf068d17c73 None None] New status for floating IP ac83117f-2968-42c5-94e7-b600d22cceec: ACTIVE {{(pid=92696) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:41:28.040271 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:30.005702 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-91b0f717-a074-47e3-bd2c-98ca1d8ede15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:32.548900 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:32.628878 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3d807b0d-c874-4b70-ae33-28fa44ed8c62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:33.759887 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:35.388692 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:41:40.566626 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-7ac171e3-f679-48a4-8bc4-85a191306ad3 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1107457
May 28 14:41:40.719765 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-546f0b5e-9183-47be-8290-fe4e6f9f0aa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:40.721310 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-546f0b5e-9183-47be-8290-fe4e6f9f0aa7 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 1098 time: 0.0719135
May 28 14:41:40.866142 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-a2f84458-2686-4e34-bbd1-4894e984c2fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:40.867576 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-a2f84458-2686-4e34-bbd1-4894e984c2fd service neutron] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 910 time: 0.1272016
May 28 14:41:40.969080 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-8aac8f04-97ec-40e1-b80f-9dce5138cc55 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=10309ae3-44cf-4796-91db-63f78b0c6d94 HTTP/1.1" status: 200  len: 1000 time: 0.0942848
May 28 14:41:41.032474 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-79033765-d271-4fe3-b1c0-c16e3a8dc17a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:41.033892 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-79033765-d271-4fe3-b1c0-c16e3a8dc17a service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0574896
May 28 14:41:41.108621 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-e4f3f189-a7a7-451d-a16e-660d01be9615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:41:41.110054 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-e4f3f189-a7a7-451d-a16e-660d01be9615 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0693250
May 28 14:41:41.121879 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-c57300c6-dfdc-4d90-901c-69fa29a3c718 service neutron] http://10.222.0.59:9696/v2.0/extensions returned with HTTP 200 {{(pid=92695) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 28 14:41:41.122809 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-c57300c6-dfdc-4d90-901c-69fa29a3c718 service neutron] 10.222.0.90 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0049682
May 28 14:41:41.253615 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-c0d29deb-65a2-4595-875a-16fbca580ed7 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1244409
May 28 14:41:41.391911 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-5850aa28-30be-4b62-8aa8-d265110a4bf6 req-d6475a3a-4e3d-45b8-9fa6-f9ff3f5f9c75 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1313915
May 28 14:41:41.524343 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:41:58.051279 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:00.011465 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0a3afba8-50fc-4ace-bf45-4651ea835c86 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:02.496815 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:02.525187 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-76a5d1d7-b779-4d32-9fd0-1dce30a02f48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:03.793979 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:05.376983 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:18.523708 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:42:28.107915 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:30.033262 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f696bfcc-ae13-43b8-8cc7-c43957b22640 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:32.501810 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:32.518814 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-99d10b9a-f4cf-4a26-bc63-4f16b95632ac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:33.793027 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:35.410655 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:40.509954 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-d3ae6e8f-2cc2-498b-af27-e3d5d92d2f36 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0741088
May 28 14:42:40.648687 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-87e06d05-8c2a-4ef5-a960-dfeccc90fb22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:42:40.650128 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-87e06d05-8c2a-4ef5-a960-dfeccc90fb22 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=61d5abfd60c747b5ad4bdeb820132545&device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 1098 time: 0.0720134
May 28 14:42:40.794191 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-52a5cab1-eee0-4726-a4cd-c0b866dc9c56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:42:40.795678 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-52a5cab1-eee0-4726-a4cd-c0b866dc9c56 service neutron] 10.222.0.90 "GET /v2.0/networks?id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 200  len: 910 time: 0.1257670
May 28 14:42:40.900014 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-59269a50-0758-415e-a499-093141156ee2 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=10309ae3-44cf-4796-91db-63f78b0c6d94 HTTP/1.1" status: 200  len: 1000 time: 0.0966177
May 28 14:42:40.964207 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-9f3868de-65af-4182-ba0f-55e41f3c2755 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:42:40.965638 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-9f3868de-65af-4182-ba0f-55e41f3c2755 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 200  len: 848 time: 0.0583079
May 28 14:42:41.048729 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-0c29d6de-345e-4e20-9b4e-f091fbb06551 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:42:41.050098 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-0c29d6de-345e-4e20-9b4e-f091fbb06551 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0757835
May 28 14:42:41.180394 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-cfb6679f-078d-4306-aad5-8dddced11ef2 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1227629
May 28 14:42:41.417633 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-bf550a07-0e6a-4e3d-acae-a8e1a8802aab req-80ff2263-4aa4-4a0c-846a-bda499af8d30 service neutron] 10.222.0.90 "GET /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2299039
May 28 14:42:51.864137 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 req-7b0ec8be-fb35-4fcc-ae88-7cf454267085 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:42:51.865672 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 req-7b0ec8be-fb35-4fcc-ae88-7cf454267085 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 945 time: 0.0796247
May 28 14:42:51.908888 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-2485df26-c5aa-4e31-b0c1-9ca92859e1d4 req-1f4cf9ec-e886-4b44-97bf-9fb2f28657bc tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0372050
May 28 14:42:53.098478 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6985fb1-3706-4ca3-9730-489a501c4904 req-4d9cf2cc-ff2e-472b-ad86-55b0b4272bb9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92694) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:42:53.099851 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a6985fb1-3706-4ca3-9730-489a501c4904 req-4d9cf2cc-ff2e-472b-ad86-55b0b4272bb9 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 945 time: 0.0850062
May 28 14:42:53.144126 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [req-a6985fb1-3706-4ca3-9730-489a501c4904 req-940e4916-f0c3-4334-8572-f056c7190075 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386093
May 28 14:42:54.084264 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f5023b3-fd81-4cc5-9df4-3bdf0250e863 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:42:54.085621 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f5023b3-fd81-4cc5-9df4-3bdf0250e863 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 945 time: 0.0827503
May 28 14:42:54.230660 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Deleting port 10309ae3-44cf-4796-91db-63f78b0c6d94 {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:42:54.230995 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:54.420461 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.db [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] For port 10309ae3-44cf-4796-91db-63f78b0c6d94, host hv-cinder-79128, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79128',level=0,port_id=10309ae3-44cf-4796-91db-63f78b0c6d94,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92695) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:42:54.420716 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:54.518340 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 req-e518bd89-f060-4caa-abde-ea41c8236b65 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92695) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 28 14:42:54.519892 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 req-e518bd89-f060-4caa-abde-ea41c8236b65 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 945 time: 0.2656062
May 28 14:42:54.659302 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-fd1886a4-bf92-44e4-90e3-3a7fec77e294 req-8341d742-100e-415b-90fe-656b0a0531f7 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups?id=b638f87d-53ec-43ad-b81f-a56cdefe318d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1292155
May 28 14:42:54.772701 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:54.773165 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-682142'] for floatingip, after_update {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:54.773683 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.db.l3_db [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Floating IP ac83117f-2968-42c5-94e7-b600d22cceec disassociated. External IP: 172.27.3.51, port: 10309ae3-44cf-4796-91db-63f78b0c6d94.
May 28 14:42:54.774262 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling delete_port for 10309ae3-44cf-4796-91db-63f78b0c6d94 owned by compute:nova {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:42:54.948484 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:54.956299 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1815c5f2-5497-43a0-8d0d-1ce86a706daa tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:42:55.005630 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event deleted for resources: {'Port': ['ID=10309ae3-44cf-4796-91db-63f78b0c6d94,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:42:55.017332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.017725 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.019133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.019133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.019133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.019133 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.019525 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.019941 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.020299 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.020656 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.021010 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.021366 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92695) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:42:55.071674 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:42:55.210184 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Router 70a9e813-5550-4032-8b40-07e33a0a7066 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92695) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:42:55.395066 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92695) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:42:55.409409 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] Sync routers for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:42:55.419082 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:42:55.419817 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2771220>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:42:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:42:55.581161 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:42:55.585861 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.l3_dvrscheduler_db [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] No DVR routers for this DVR port 10309ae3-44cf-4796-91db-63f78b0c6d94 on host hv-cinder-79128 {{(pid=92695) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:42:55.588594 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for port, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:55.592533 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'name': 'network-vif-deleted', 'tag': '10309ae3-44cf-4796-91db-63f78b0c6d94'}] {{(pid=92695) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 28 14:42:55.608751 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:42:55.662882 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-b11e6a55-2a6f-4635-9ac4-9404d9fe0b5c req-6f9ef7b0-3604-4938-9565-058a5e68ff2d tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.90 "DELETE /v2.0/ports/10309ae3-44cf-4796-91db-63f78b0c6d94 HTTP/1.1" status: 204  len: 173 time: 1.5709634
May 28 14:42:55.690743 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '08dfb653-07bf-461d-bd53-3f1346a89bb9', 'name': 'network-vif-deleted', 'tag': '10309ae3-44cf-4796-91db-63f78b0c6d94', 'status': 'completed', 'code': 200}
May 28 14:42:55.808921 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-d9d808b3-ad85-4189-8f71-e5190a1fe52c req-ec7333ac-3a69-420b-acf5-83ba6754f780 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Synchronizing usage tracker for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92695) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 28 14:42:55.878052 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [req-d9d808b3-ad85-4189-8f71-e5190a1fe52c req-ec7333ac-3a69-420b-acf5-83ba6754f780 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Unset dirty status for tenant:61d5abfd60c747b5ad4bdeb820132545 on resource:port {{(pid=92695) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 28 14:42:55.879277 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [req-d9d808b3-ad85-4189-8f71-e5190a1fe52c req-ec7333ac-3a69-420b-acf5-83ba6754f780 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/ports?device_id=08dfb653-07bf-461d-bd53-3f1346a89bb9 HTTP/1.1" status: 200  len: 210 time: 0.1114500
May 28 14:42:55.962475 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2771220>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:42:55.967090 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] Checking router: 70a9e813-5550-4032-8b40-07e33a0a7066 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:42:55.975677 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:42:55.976278 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba2771220>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:42:32Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:42:56.151436 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:42:56.488203 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba2771220>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:42:56.492156 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7904ed5b-d3ee-4993-ac5e-36062b15c863 None None] The sync data for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi is: [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:35:52Z', 'revision_number': 4, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi', '_interfaces': [{'id': '6a43bb26-ad55-4dab-aca2-7b62cc6955c6', 'name': '', 'network_id': 'd07aad82-58f0-48c7-bdbc-4ebfe5f698dc', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'mac_address': 'fa:16:3e:81:b7:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_interface', 'standard_attr_id': 626, 'fixed_ips': [{'subnet_id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:51Z', 'updated_at': '2021-05-28T14:35:57Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'subnets': [{'id': '097b2b8c-d0d5-4b10-a710-a27ac2380514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:42:56.648307 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 10309ae3-44cf-4796-91db-63f78b0c6d94 no longer exists at agent hyperv_hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:42:56.723487 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] No Port match for: 10309ae3-44cf-4796-91db-63f78b0c6d94 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:42:56.723864 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Device 10309ae3-44cf-4796-91db-63f78b0c6d94 not bound to the agent host hv-cinder-79128 {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:42:56.725483 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97484ab5-990c-4eea-a680-9d95e56ac717 None None] New status for floating IP ac83117f-2968-42c5-94e7-b600d22cceec: DOWN {{(pid=92696) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 28 14:42:57.074170 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 41530) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:42:57.140914 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eda85185-0e7a-48e2-8713-b70a5147f2cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:57.167912 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eda85185-0e7a-48e2-8713-b70a5147f2cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:57.278620 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eda85185-0e7a-48e2-8713-b70a5147f2cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:57.283480 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-493df225-bfd4-4b82-9b60-769cbd830e2c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:42:57.301077 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda85185-0e7a-48e2-8713-b70a5147f2cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b638f87d-53ec-43ad-b81f-a56cdefe318d,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:42:57.303641 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eda85185-0e7a-48e2-8713-b70a5147f2cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:42:57.369845 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eda85185-0e7a-48e2-8713-b70a5147f2cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:57.370952 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-eda85185-0e7a-48e2-8713-b70a5147f2cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /v2.0/security-groups/b638f87d-53ec-43ad-b81f-a56cdefe318d HTTP/1.1" status: 204  len: 168 time: 0.2957892
May 28 14:42:57.373747 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 41534) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:42:57.389872 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.api.v2.resource [None req-52bf3d6b-438f-4511-8320-36cb015b952e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] show failed (client error): The resource could not be found.
May 28 14:42:57.391440 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-52bf3d6b-438f-4511-8320-36cb015b952e tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "GET /v2.0/security-groups/b638f87d-53ec-43ad-b81f-a56cdefe318d HTTP/1.1" status: 404  len: 347 time: 0.0162909
May 28 14:42:57.394042 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 41538) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:42:57.612160 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Deleting port f4bdd294-0aeb-4eff-84ea-5002ea3b488e {{(pid=92695) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:42:57.612418 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:57.729003 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:57.729332 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:57.852031 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.plugins.ml2.plugin [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Calling delete_port for f4bdd294-0aeb-4eff-84ea-5002ea3b488e owned by network:floatingip {{(pid=92695) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:42:58.033067 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1697877'] for port, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:58.037919 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-037b47a3-61be-4eb4-bd76-88a345e2d835 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:42:58.072904 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:58.084494 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Pushing event deleted for resources: {'Port': ['ID=f4bdd294-0aeb-4eff-84ea-5002ea3b488e,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:42:58.111129 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:42:58.174316 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks [] for floatingip, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:58.231971 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-106794'] for floatingip, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:42:58.233157 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-858dc1fa-d599-46b5-b5ce-8c96c9568d94 tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] 10.222.0.59 "DELETE /v2.0/floatingips/ac83117f-2968-42c5-94e7-b600d22cceec HTTP/1.1" status: 204  len: 168 time: 0.8381834
May 28 14:43:00.016064 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f90ca4ac-d1fd-49bb-9514-c3f950e49421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:02.541606 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:02.575484 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0d1e9fb5-0e66-4054-9cf2-37c955359a75 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:02.677650 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41568) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:03.441345 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-681900'] for router_interface, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:03.770023 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:03.869912 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Deleting port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:43:03.870581 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:03.988131 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] For port 6a43bb26-ad55-4dab-aca2-7b62cc6955c6, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=6a43bb26-ad55-4dab-aca2-7b62cc6955c6,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:43:03.988479 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:04.122862 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Calling delete_port for 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 owned by network:router_interface {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:43:04.341259 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:04.345246 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-95e93089-51b1-4ac2-9c0c-468ffdbd091c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:04.388144 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Pushing event deleted for resources: {'Port': ['ID=6a43bb26-ad55-4dab-aca2-7b62cc6955c6,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:04.421993 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.422383 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.422749 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.423118 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.423473 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.423871 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.424225 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.424577 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.424931 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.425284 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.425636 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.425984 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92694) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:04.433913 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:04.772450 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551923', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-685116'] for router_interface, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:05.137619 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Router 70a9e813-5550-4032-8b40-07e33a0a7066 has already been hosted by L3 agent 3fe9e479-2ce8-4be0-a938-48ea49ac9833 {{(pid=92694) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 28 14:43:05.323430 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] Notify agent at l3_agent.dv-cinder-791281-3-iscsi the message routers_updated {{(pid=92694) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 28 14:43:05.332304 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] Sync routers for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 28 14:43:05.338847 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-4f8d4269-da41-4170-8127-9ce83f51354c admin admin] 10.222.0.59 "PUT /v2.0/routers/70a9e813-5550-4032-8b40-07e33a0a7066/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6584456
May 28 14:43:05.339880 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41582) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:05.342176 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:43:05.342837 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27dac70>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:43:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:43:05.387849 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:05.517321 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks [] for router, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:05.521448 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: dv-cinder-791281-3-iscsi {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:43:05.694290 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:05.799776 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27dac70>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'external_fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180'}], 'enable_snat': True}, 'gw_port_id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:43:04Z', 'revision_number': 5, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port': {'id': 'ceb644dd-c4ef-4e1b-80fe-6e4a47970da2', 'name': '', 'network_id': 'f203e1e9-7403-4723-8925-7d733bca2c40', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:65:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'device_owner': 'network:router_gateway', 'standard_attr_id': 625, 'fixed_ips': [{'subnet_id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'ip_address': '172.27.3.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791281-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-28T14:35:48Z', 'updated_at': '2021-05-28T14:35:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0cd2108-42a0-4380-970f-9928591eb252', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791281-3-iscsi'}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:43:05.803511 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] Checking router: 70a9e813-5550-4032-8b40-07e33a0a7066 for host: dv-cinder-791281-3-iscsi {{(pid=92697) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 28 14:43:05.812071 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] Routers {'70a9e813-5550-4032-8b40-07e33a0a7066'} bound to L3 agent in host dv-cinder-791281-3-iscsi {{(pid=92697) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 28 14:43:05.812675 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fbba27dac70>, 'dv-cinder-791281-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-28T14:13:02Z,description=<?>,heartbeat_timestamp=2021-05-28T14:43:02Z,host='dv-cinder-791281-3-iscsi',id=3fe9e479-2ce8-4be0-a938-48ea49ac9833,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-28T14:13:03Z,topic='l3_agent')) {'router_ids': ['70a9e813-5550-4032-8b40-07e33a0a7066'], 'active': True} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:43:05.832466 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Deleting port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:43:05.832804 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:05.966184 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_dvr_db [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] Set router 70a9e813-5550-4032-8b40-07e33a0a7066 gateway port host: None {{(pid=92697) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 28 14:43:06.071508 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] For port ceb644dd-c4ef-4e1b-80fe-6e4a47970da2, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=ceb644dd-c4ef-4e1b-80fe-6e4a47970da2,segment=NetworkSegment(05effb8c-4f51-4169-bfda-7593cb4b5695),segment_id=05effb8c-4f51-4169-bfda-7593cb4b5695)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:43:06.071909 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:06.074750 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.l3_hamode_db [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fbba27dac70>, [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:43:05Z', 'revision_number': 6, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port_host': None}], 'dv-cinder-791281-3-iscsi', False) {} {{(pid=92697) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:43:06.079390 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b12f8f5a-43c3-4905-a2e4-838ba111792f None None] The sync data for ids ['70a9e813-5550-4032-8b40-07e33a0a7066'] in dv-cinder-791281-3-iscsi is: [{'id': '70a9e813-5550-4032-8b40-07e33a0a7066', 'name': 'tempest-AttachVolumeTestJSON-84730337-router', 'tenant_id': '61d5abfd60c747b5ad4bdeb820132545', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-28T14:35:47Z', 'updated_at': '2021-05-28T14:43:05Z', 'revision_number': 6, 'project_id': '61d5abfd60c747b5ad4bdeb820132545', 'gw_port_host': None}] {{(pid=92697) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 28 14:43:06.197448 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Calling delete_port for ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 owned by network:router_gateway {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:43:06.398605 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:06.403458 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-dd5d222d-6e8d-4ce2-a6e7-c446701fcd9a tempest-TestShelveInstance-2125428005 tempest-TestShelveInstance-2125428005-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:06.449301 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Pushing event deleted for resources: {'Port': ['ID=ceb644dd-c4ef-4e1b-80fe-6e4a47970da2,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:06.478678 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:06.549649 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-682161'] for router_gateway, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:06.733482 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-685628', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31078'] for router, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:06.736257 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:06.849831 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-684032'] for router, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:06.850495 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 70a9e813-5550-4032-8b40-07e33a0a7066 {{(pid=92694) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 28 14:43:06.865261 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] Notify callbacks [] for router, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:06.866409 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-438c9baf-3f2a-4889-8139-a470b1f56f57 admin admin] 10.222.0.59 "DELETE /v2.0/routers/70a9e813-5550-4032-8b40-07e33a0a7066 HTTP/1.1" status: 204  len: 168 time: 1.5254781
May 28 14:43:06.870062 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41588) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:06.939113 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.db_base_plugin_v2 [None req-e6967167-0093-40e6-9678-4b663d768f58 admin admin] Deleting subnet 097b2b8c-d0d5-4b10-a710-a27ac2380514 {{(pid=92694) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 28 14:43:06.942578 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6967167-0093-40e6-9678-4b663d768f58 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:06.994955 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6967167-0093-40e6-9678-4b663d768f58 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1655020'] for subnet, precommit_delete_associations {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:07.079947 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6967167-0093-40e6-9678-4b663d768f58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8330469'] for subnet, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:07.422283 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6967167-0093-40e6-9678-4b663d768f58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8329552', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3483512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3521832'] for subnet, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:07.426402 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-c1ca7331-1caf-47f4-ad39-f152518c88c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:07.460818 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6967167-0093-40e6-9678-4b663d768f58 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=097b2b8c-d0d5-4b10-a710-a27ac2380514,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:07.464306 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e6967167-0093-40e6-9678-4b663d768f58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:07.466807 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e6967167-0093-40e6-9678-4b663d768f58 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for subnet, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:07.473387 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e6967167-0093-40e6-9678-4b663d768f58 admin admin] 10.222.0.59 "DELETE /v2.0/subnets/097b2b8c-d0d5-4b10-a710-a27ac2380514 HTTP/1.1" status: 204  len: 168 time: 0.6023254
May 28 14:43:07.473960 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-240b0b22-6581-43cc-a488-21e3c19b5fd2 None None] Network d07aad82-58f0-48c7-bdbc-4ebfe5f698dc requested from dv-cinder-791281-3-iscsi {{(pid=92696) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 28 14:43:07.475803 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41592) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:07.486676 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:43:07.529361 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:43:07.529713 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device ceb644dd-c4ef-4e1b-80fe-6e4a47970da2 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:43:07.530142 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:43:07.584775 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7931281'] for network, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:07.616901 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:43:07.617249 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device 6a43bb26-ad55-4dab-aca2-7b62cc6955c6 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:43:07.661181 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Deleting port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 {{(pid=92694) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:43:07.661458 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:07.792618 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] DHCP port deletion for d07aad82-58f0-48c7-bdbc-4ebfe5f698dc request from dv-cinder-791281-3-iscsi {{(pid=92696) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 28 14:43:07.865622 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Deleting port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 {{(pid=92696) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 28 14:43:07.866011 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8777742693187'] for port, before_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:07.866899 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.db [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] For port c04dbd92-2a83-4e74-ba1b-b2de1b03c304, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=c04dbd92-2a83-4e74-ba1b-b2de1b03c304,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92694) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:43:07.867255 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:07.970942 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.db [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] For port c04dbd92-2a83-4e74-ba1b-b2de1b03c304, host dv-cinder-791281-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791281-3-iscsi',level=0,port_id=c04dbd92-2a83-4e74-ba1b-b2de1b03c304,segment=NetworkSegment(7e96cd57-3fa8-4cba-8c1a-78ddd0b13668),segment_id=7e96cd57-3fa8-4cba-8c1a-78ddd0b13668)] {{(pid=92696) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 28 14:43:07.971332 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683389'] for port, precommit_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:07.999276 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.plugin [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Calling delete_port for c04dbd92-2a83-4e74-ba1b-b2de1b03c304 owned by network:dhcp {{(pid=92694) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:43:08.093773 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Calling delete_port for c04dbd92-2a83-4e74-ba1b-b2de1b03c304 owned by network:dhcp {{(pid=92696) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 28 14:43:08.141590 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3422859'] for port, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:08.146556 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7750910c-05d6-4671-8ffd-9e8f36f249cc tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:08.146967 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7947006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-521817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551905', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8777742695590', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8777742261980'] for port, after_delete {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:08.151823 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:08.196078 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Pushing event deleted for resources: {'Port': ['ID=c04dbd92-2a83-4e74-ba1b-b2de1b03c304,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:08.196973 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Pushing event deleted for resources: {'Port': ['ID=c04dbd92-2a83-4e74-ba1b-b2de1b03c304,revision_number=None']} {{(pid=92696) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:08.197859 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] No DVR routers for this DVR port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 on host dv-cinder-791281-3-iscsi {{(pid=92694) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:43:08.199316 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:08.202835 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] No DVR routers for this DVR port c04dbd92-2a83-4e74-ba1b-b2de1b03c304 on host dv-cinder-791281-3-iscsi {{(pid=92696) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 28 14:43:08.209810 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.209988 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.210382 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.213585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.213585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.213585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.213585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.213585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.213585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.213585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.213585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.213585 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791281-3-iscsi {{(pid=92696) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 28 14:43:08.217629 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG oslo_concurrency.lockutils [None req-6ce22275-d065-4e52-a83f-692f66e19dc2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:08.315077 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8327530', 'neutron.services.segments.db._delete_segments_for_network-8777742722780'] for network, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:08.327802 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fbba1f71d90>,) {'filters': {'network_id': ['d07aad82-58f0-48c7-bdbc-4ebfe5f698dc']}} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:43:08.339511 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba1f71d90>, '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668') {'for_net_delete': True} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:43:08.339832 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.services.segments.db [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fbba1f71d90>, '7e96cd57-3fa8-4cba-8c1a-78ddd0b13668') {} {{(pid=92694) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 28 14:43:08.351326 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8777742731933', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1655015'] for segment, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:08.367677 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674'] for segment, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:08.373753 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Releasing vlan 851 on physical network physnet1 to pool {{(pid=92694) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 28 14:43:08.374127 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8350674', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3422942'] for segment, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]: Traceback (most recent call last):
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     timer()
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     cb(*args, **kw)
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     return func(*args, **kwargs)
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     self._notify()
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     self.callback(batched_events)
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     event.method(event)
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     aggregate_uuid = self.p_client.list_aggregates(
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     return f(self, *a, **k)
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._get(url).json()
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     return self.request(url, 'GET', **kwargs)
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     base_url = self.get_endpoint(auth, allow=allow,
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 28 14:43:08.386853 dv-cinder-791281-3-iscsi neutron-server[92694]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 28 14:43:08.529062 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8327523', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-673101', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-682156'] for network, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:08.533247 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:08.545788 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551903'] for network, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:08.557576 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Pushing event deleted for resources: {'Network': ['ID=d07aad82-58f0-48c7-bdbc-4ebfe5f698dc,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:08.561745 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:08.649886 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-8abfc3de-d2d7-4b3b-aa27-cb00370671e8 admin admin] 10.222.0.59 "DELETE /v2.0/networks/d07aad82-58f0-48c7-bdbc-4ebfe5f698dc HTTP/1.1" status: 204  len: 168 time: 1.1729815
May 28 14:43:08.926143 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41598) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:08.976140 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5c68b085-ebe3-4465-8128-86b3af4e597c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=61d5abfd60c747b5ad4bdeb820132545&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0487235
May 28 14:43:08.978392 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41602) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:09.035690 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f785ca6b-f1f4-4159-b587-2223e34e2d1c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:09.061194 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f785ca6b-f1f4-4159-b587-2223e34e2d1c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:09.272586 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f785ca6b-f1f4-4159-b587-2223e34e2d1c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:09.276454 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e1fcd7cb-4e22-4d38-83a6-89e105716060 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:09.290471 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f785ca6b-f1f4-4159-b587-2223e34e2d1c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07daab05-f59c-4c6f-a818-063c4ca15904,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:09.294302 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f785ca6b-f1f4-4159-b587-2223e34e2d1c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:09.297822 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f785ca6b-f1f4-4159-b587-2223e34e2d1c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:09.298933 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-f785ca6b-f1f4-4159-b587-2223e34e2d1c admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/07daab05-f59c-4c6f-a818-063c4ca15904 HTTP/1.1" status: 204  len: 168 time: 0.3196626
May 28 14:43:09.460031 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device c04dbd92-2a83-4e74-ba1b-b2de1b03c304 no longer exists at agent ovs-agent-dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 28 14:43:09.496745 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.plugin [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] No Port match for: c04dbd92-2a83-4e74-ba1b-b2de1b03c304 {{(pid=92696) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 28 14:43:09.497101 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron.plugins.ml2.rpc [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Device c04dbd92-2a83-4e74-ba1b-b2de1b03c304 not bound to the agent host dv-cinder-791281-3-iscsi {{(pid=92696) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 28 14:43:14.477105 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [req-e1037d8a-1cd6-4491-b1e9-3ff0cf9267d7 req-44c6a508-3847-4c5b-8840-4932158ac54d service neutron] (92695) timed out ('10.222.0.90', 61273) {{(pid=92695) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 28 14:43:14.538902 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41666) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:14.657390 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:14.671254 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:43:14.675536 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] Usage tracker for resource:security_group_rule and tenant:e1a93304d1784f6686ae87db4a30bb04 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:43:14.678293 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:43:14.683986 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:43:14.766304 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:14.848707 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:14.856051 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-43055eaa-b29e-4740-8c7b-941b321a40ff tempest-TestVolumeBootPattern-668211187 tempest-TestVolumeBootPattern-668211187-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:14.896336 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4991df2e-11fc-472f-9996-2c4c4801d4bd,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:14.899435 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:14.902100 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5e247dfa-85ad-4897-b711-64229dfb63d6 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=e1a93304d1784f6686ae87db4a30bb04&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3622313
May 28 14:43:14.904791 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41672) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:14.962177 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f1001b73-a209-4728-9023-25377d7b16ed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:14.988291 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f1001b73-a209-4728-9023-25377d7b16ed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:15.106835 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f1001b73-a209-4728-9023-25377d7b16ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:15.111151 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-db459ca6-1678-4c5c-9646-32543f7492f9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:15.122330 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1001b73-a209-4728-9023-25377d7b16ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4991df2e-11fc-472f-9996-2c4c4801d4bd,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:15.126970 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f1001b73-a209-4728-9023-25377d7b16ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:15.128818 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-f1001b73-a209-4728-9023-25377d7b16ed admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:15.129928 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-f1001b73-a209-4728-9023-25377d7b16ed admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/4991df2e-11fc-472f-9996-2c4c4801d4bd HTTP/1.1" status: 204  len: 168 time: 0.2243581
May 28 14:43:15.165065 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [req-6683ba66-a0b0-4a5c-baeb-2bdd0c157103 req-137d5a37-89a5-4ab0-8f21-a01408694987 tempest-VolumesSnapshotTestJSON-1858770956 tempest-VolumesSnapshotTestJSON-1858770956-project] (92694) timed out ('10.222.0.90', 61312) {{(pid=92694) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 28 14:43:17.334797 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 41714) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:17.450707 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:17.465846 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:43:17.469630 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] Usage tracker for resource:security_group_rule and tenant:11ecc469c2af473ea69b0c80cbdab66c is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:43:17.472453 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:43:17.478064 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:43:17.561764 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:17.643887 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:17.651334 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-039d2dc5-a826-444b-9065-3b097a72fef0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:17.692944 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=11ecc469c2af473ea69b0c80cbdab66c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3569458
May 28 14:43:17.693789 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7249c571-ae6c-474d-9bd3-b350cab8b4d3,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:17.695489 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41720) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:17.697410 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-5c9032d3-4e8b-4da6-8519-80aa14fb7d9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:17.757073 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5c6a7b2a-9491-4c06-9aeb-8dc0e7898b23 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:17.783033 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5c6a7b2a-9491-4c06-9aeb-8dc0e7898b23 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:17.923840 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5c6a7b2a-9491-4c06-9aeb-8dc0e7898b23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:17.927468 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-f785ca6b-f1f4-4159-b587-2223e34e2d1c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:17.941062 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c6a7b2a-9491-4c06-9aeb-8dc0e7898b23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7249c571-ae6c-474d-9bd3-b350cab8b4d3,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:17.944419 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5c6a7b2a-9491-4c06-9aeb-8dc0e7898b23 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:17.947009 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-5c6a7b2a-9491-4c06-9aeb-8dc0e7898b23 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:17.948671 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-5c6a7b2a-9491-4c06-9aeb-8dc0e7898b23 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/7249c571-ae6c-474d-9bd3-b350cab8b4d3 HTTP/1.1" status: 204  len: 168 time: 0.2522111
May 28 14:43:18.518988 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41728) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:18.537258 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:18.551502 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:43:18.555366 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] Usage tracker for resource:security_group_rule and tenant:62e6ecb1a26e47179df3f7025cc1113d is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:43:18.558183 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:43:18.563899 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:43:18.649251 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:18.706323 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:18.713357 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5cd36f53-42a7-43c0-9d14-ede48cf7025e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:18.755183 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c48cf09c-8e03-4036-a2eb-cbee504a8f2e,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:18.759373 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=62e6ecb1a26e47179df3f7025cc1113d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2393537
May 28 14:43:18.760350 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-754a40e5-0382-4232-aa6e-ec3685b5b6e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:18.762646 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41732) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:18.820765 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8ee2e001-d3d6-4d09-ad72-e04a3246643c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:18.846525 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8ee2e001-d3d6-4d09-ad72-e04a3246643c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:18.975445 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8ee2e001-d3d6-4d09-ad72-e04a3246643c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:18.979484 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ffa75ee8-e394-4d7b-bda7-662951013a51 tempest-AttachVolumeShelveTestJSON-204543580 tempest-AttachVolumeShelveTestJSON-204543580-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:18.992483 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee2e001-d3d6-4d09-ad72-e04a3246643c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c48cf09c-8e03-4036-a2eb-cbee504a8f2e,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:18.995003 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-8ee2e001-d3d6-4d09-ad72-e04a3246643c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:18.998454 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-8ee2e001-d3d6-4d09-ad72-e04a3246643c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:19.000750 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-8ee2e001-d3d6-4d09-ad72-e04a3246643c admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/c48cf09c-8e03-4036-a2eb-cbee504a8f2e HTTP/1.1" status: 204  len: 168 time: 0.2371798
May 28 14:43:24.392074 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 41868) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:24.513209 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:24.531962 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:43:24.535694 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] Usage tracker for resource:security_group_rule and tenant:4503490d0fa6496aadb3f576ef73fb84 is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:43:24.538413 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:43:24.544154 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:43:24.623513 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:24.706536 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:24.713870 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-5c6a7b2a-9491-4c06-9aeb-8dc0e7898b23 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:24.756734 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=4503490d0fa6496aadb3f576ef73fb84&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3633687
May 28 14:43:24.757723 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=85389b03-1471-4453-aeeb-c4bcbc54cfd0,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:24.759259 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 41874) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:24.760935 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-1cc74958-db0e-439b-aa32-556e651d267a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:24.820873 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1ffb8ab0-ff8b-449a-bbe7-ac6d94e83a09 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:24.847114 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1ffb8ab0-ff8b-449a-bbe7-ac6d94e83a09 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:24.963712 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1ffb8ab0-ff8b-449a-bbe7-ac6d94e83a09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:24.967548 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eda85185-0e7a-48e2-8713-b70a5147f2cb tempest-AttachVolumeTestJSON-1314274585 tempest-AttachVolumeTestJSON-1314274585-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:24.980308 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ffb8ab0-ff8b-449a-bbe7-ac6d94e83a09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85389b03-1471-4453-aeeb-c4bcbc54cfd0,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:24.982905 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1ffb8ab0-ff8b-449a-bbe7-ac6d94e83a09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:24.990926 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1ffb8ab0-ff8b-449a-bbe7-ac6d94e83a09 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:24.992069 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-1ffb8ab0-ff8b-449a-bbe7-ac6d94e83a09 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/85389b03-1471-4453-aeeb-c4bcbc54cfd0 HTTP/1.1" status: 204  len: 168 time: 0.2316852
May 28 14:43:25.617769 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 41882) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:25.639297 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:25.654183 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:43:25.658042 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] Usage tracker for resource:security_group_rule and tenant:93bfa99ab2f14a1db6eb5e11e003adf6 is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:43:25.660824 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:43:25.668162 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:43:25.750282 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:25.810366 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:25.818809 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-a4b2d860-43a8-436a-865a-9b73a0219159 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:25.857656 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7a7277c-0fdf-46b5-a5b9-5ec38cc3f242,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:25.862209 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=93bfa99ab2f14a1db6eb5e11e003adf6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2432241
May 28 14:43:25.863098 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-1df31781-786f-4b8a-a616-f1bb0c2b132c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:25.864924 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 41886) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:25.923349 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10d34589-4cec-4210-b7cd-9d81fd2fe6b2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:25.948391 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10d34589-4cec-4210-b7cd-9d81fd2fe6b2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:26.089638 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10d34589-4cec-4210-b7cd-9d81fd2fe6b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:26.093846 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-58293e8f-e67e-4f27-a170-d75044b54246 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:26.105013 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10d34589-4cec-4210-b7cd-9d81fd2fe6b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7a7277c-0fdf-46b5-a5b9-5ec38cc3f242,revision_number=None']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:26.107425 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-10d34589-4cec-4210-b7cd-9d81fd2fe6b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:26.114368 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-10d34589-4cec-4210-b7cd-9d81fd2fe6b2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:26.115499 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-10d34589-4cec-4210-b7cd-9d81fd2fe6b2 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/d7a7277c-0fdf-46b5-a5b9-5ec38cc3f242 HTTP/1.1" status: 204  len: 168 time: 0.2497020
May 28 14:43:28.066466 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:30.009478 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-c1fd2ebf-d08b-4aa7-93d4-98a9feaba11e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:32.512639 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:32.547368 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-642edb56-4b9a-4bec-9ebe-7e1da5a90972 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:32.570145 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:43:33.769502 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:35.397727 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:40.992390 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 42022) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:41.109719 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:41.124374 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:43:41.128282 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] Usage tracker for resource:security_group_rule and tenant:3e74e3653fb041318401e94b89bd9f6f is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:43:41.131089 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:43:41.136882 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:43:41.219618 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:41.289051 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:41.298037 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-b7833438-47bb-4758-b9a9-2340b79eb78f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:41.338075 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=3e74e3653fb041318401e94b89bd9f6f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3445625
May 28 14:43:41.339293 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c73c54b-f970-4011-810e-0b24d6d8a22c,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:41.340755 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 42028) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:41.345020 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-960a0a2d-f4d5-4e46-a17e-29466ad886e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:41.400928 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-082b6dc2-da50-47b8-b54b-52fc45118f55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:41.427206 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-082b6dc2-da50-47b8-b54b-52fc45118f55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:41.557467 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-082b6dc2-da50-47b8-b54b-52fc45118f55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:41.561245 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-ec407725-1446-4d2e-a58a-ce5df2425783 tempest-TestMinimumBasicScenario-279905479 tempest-TestMinimumBasicScenario-279905479-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:41.577615 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-082b6dc2-da50-47b8-b54b-52fc45118f55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c73c54b-f970-4011-810e-0b24d6d8a22c,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:41.580932 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-082b6dc2-da50-47b8-b54b-52fc45118f55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:41.588515 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-082b6dc2-da50-47b8-b54b-52fc45118f55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:41.589569 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-082b6dc2-da50-47b8-b54b-52fc45118f55 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/0c73c54b-f970-4011-810e-0b24d6d8a22c HTTP/1.1" status: 204  len: 168 time: 0.2478311
May 28 14:43:42.252836 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 42036) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:42.271436 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:42.287009 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:43:42.291347 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] Usage tracker for resource:security_group_rule and tenant:73b7fe7d13ac431d8938da0c6fad286a is out of sync, need to count used quota {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:43:42.294224 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.quota.resource [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92694) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:43:42.300040 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.db.quota.driver [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92694) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:43:42.382419 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:42.489072 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:42.496927 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-6d12173e-29e5-468e-a43d-413e9e63c75f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:42.537288 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ec2601d-2e7b-48d2-83b4-74fdcdc86892,revision_number=1']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:42.541620 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=73b7fe7d13ac431d8938da0c6fad286a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2877738
May 28 14:43:42.542553 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-df650a5b-e5cf-4066-b276-049c02c17be0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:42.544926 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 42040) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:42.602737 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-99ec6222-3517-46b4-8b7d-bfa289743220 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:42.628399 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-99ec6222-3517-46b4-8b7d-bfa289743220 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:42.769718 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-99ec6222-3517-46b4-8b7d-bfa289743220 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:42.773710 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7539c740-2fbd-4fc5-9cfe-fb37b52a3f28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:42.784879 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ec6222-3517-46b4-8b7d-bfa289743220 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ec2601d-2e7b-48d2-83b4-74fdcdc86892,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:42.787247 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-99ec6222-3517-46b4-8b7d-bfa289743220 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:42.793106 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-99ec6222-3517-46b4-8b7d-bfa289743220 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:42.794211 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-99ec6222-3517-46b4-8b7d-bfa289743220 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/6ec2601d-2e7b-48d2-83b4-74fdcdc86892 HTTP/1.1" status: 204  len: 168 time: 0.2489774
May 28 14:43:43.451033 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 42048) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:43.469833 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:43.484811 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:43:43.488609 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] Usage tracker for resource:security_group_rule and tenant:24b2df064c754e5da60a712f4569210b is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:43:43.491363 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:43:43.497358 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:43:43.584559 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:43.626215 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:43.633683 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-e9e2a85f-e59c-40f7-a251-698ce277f0d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:43.674779 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=24b2df064c754e5da60a712f4569210b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2226315
May 28 14:43:43.675694 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=adc04aba-6429-408d-9ddd-c74fe6bdafe3,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:43.677532 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 42052) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:43.678593 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-39db0647-e9de-4469-8d6a-686e6ee15fbf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:43.736286 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1407225-c15e-43e9-8292-4812eccc54c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:43.762170 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1407225-c15e-43e9-8292-4812eccc54c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:43.894678 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1407225-c15e-43e9-8292-4812eccc54c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:43.898581 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-7b97f9d7-2b8e-4ddf-8e7f-cfb3c1b04063 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:43.909810 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1407225-c15e-43e9-8292-4812eccc54c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=adc04aba-6429-408d-9ddd-c74fe6bdafe3,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:43.912170 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-e1407225-c15e-43e9-8292-4812eccc54c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:43.917513 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-e1407225-c15e-43e9-8292-4812eccc54c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:43.918641 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-e1407225-c15e-43e9-8292-4812eccc54c3 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/adc04aba-6429-408d-9ddd-c74fe6bdafe3 HTTP/1.1" status: 204  len: 168 time: 0.2401378
May 28 14:43:50.704362 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [-] (92695) accepted ('10.222.0.59', 42120) {{(pid=92695) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:50.853862 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:50.868493 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 28 14:43:50.872463 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] Usage tracker for resource:security_group_rule and tenant:860c1258f8c942f5965becd5bc6c4d6a is out of sync, need to count used quota {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 28 14:43:50.875236 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.quota.resource [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92695) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 28 14:43:50.881444 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.db.quota.driver [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92695) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 28 14:43:50.962293 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:51.042870 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron_lib.callbacks.manager [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_create {{(pid=92695) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:51.050465 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-832a5853-50c6-4782-afd4-bb9be6e9047b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:51.093031 dv-cinder-791281-3-iscsi neutron-server[92695]: INFO neutron.wsgi [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] 10.222.0.59 "GET /v2.0/security-groups?tenant_id=860c1258f8c942f5965becd5bc6c4d6a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3875687
May 28 14:43:51.094698 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4a26490-0b07-46b7-8bfa-65dd9b81a8bf,revision_number=1']} {{(pid=92695) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:51.095631 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [-] (92694) accepted ('10.222.0.59', 42126) {{(pid=92694) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 28 14:43:51.105033 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG oslo_concurrency.lockutils [None req-eef470b4-a478-465c-bab6-a606cda16aa9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:51.161931 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-32a326c0-2627-4f9a-92f8-83cfebfee1c0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:51.190760 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-32a326c0-2627-4f9a-92f8-83cfebfee1c0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:51.306241 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-32a326c0-2627-4f9a-92f8-83cfebfee1c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-673137'] for security_group, after_delete {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:51.310050 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-2bbe0988-ac26-42da-af6a-da939a1e15ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 28 14:43:51.321562 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32a326c0-2627-4f9a-92f8-83cfebfee1c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4a26490-0b07-46b7-8bfa-65dd9b81a8bf,revision_number=None']} {{(pid=92694) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 28 14:43:51.325010 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG oslo_concurrency.lockutils [None req-32a326c0-2627-4f9a-92f8-83cfebfee1c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 28 14:43:51.328164 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron_lib.callbacks.manager [None req-32a326c0-2627-4f9a-92f8-83cfebfee1c0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92694) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:43:51.329259 dv-cinder-791281-3-iscsi neutron-server[92694]: INFO neutron.wsgi [None req-32a326c0-2627-4f9a-92f8-83cfebfee1c0 admin admin] 10.222.0.59 "DELETE /v2.0/security-groups/f4a26490-0b07-46b7-8bfa-65dd9b81a8bf HTTP/1.1" status: 204  len: 168 time: 0.2326434
May 28 14:43:58.094671 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:00.014443 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-28a49c75-058d-410f-9d85-a115bf83b9d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:02.551908 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:02.597719 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-fc241bc6-704c-4e12-b7c7-5d1064331b62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:03.774403 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:05.403313 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:09.595705 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:44:28.128619 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:30.025309 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f3c7cf74-c3e5-4c63-acee-483be63c56fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:32.522242 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:32.562464 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f4ffbb90-ba77-4f24-821f-9e78ffed4e5b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:33.785495 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:35.425466 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:44:46.575020 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:44:58.099412 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:00.036018 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-983f5fb7-e85f-4399-b168-5b95625db944 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:02.517049 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:02.538920 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-46a4ee2c-220b-4ee9-9e81-2f7a0cd5dad1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:03.783320 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:05.436224 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:23.574015 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:45:28.105281 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:30.035866 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-4e38d0fd-0032-4f81-be3f-0598090a6214 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:32.526625 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:32.548513 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-e001539e-4860-4fa8-802e-d8d0905637fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:33.784558 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:35.424992 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:45:58.098501 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:00.012340 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-8547a577-4346-4d63-a76f-37bb83b868d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:00.572323 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:46:02.549635 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:02.560579 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b9592d22-034f-48e1-a598-a1ee6931f991 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:03.823884 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:05.389057 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:28.107652 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:30.023251 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-db21f010-9a58-44b4-ac9a-d3e95107e0b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:32.525997 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:32.575825 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-3535b974-2af7-400d-bb93-87b6cc0d341d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:33.800835 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:35.434631 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:46:37.571277 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:46:40.722493 dv-cinder-791281-3-iscsi neutron-server[92695]: DEBUG neutron.wsgi [req-c6f16136-5b7f-46e5-b795-e5524b50ac0b req-ba013851-2dc7-4deb-b8c2-e6bfa2929bc8 service neutron] (92695) timed out ('10.222.0.90', 61827) {{(pid=92695) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 28 14:46:58.160442 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:00.022909 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-6966bf3d-0ea2-4995-9849-1f7c4a8ba7b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:02.560561 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:02.571226 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-fcaede61-d27a-4393-a334-a2ed17645696 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:03.788803 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:05.457112 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:14.570489 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:47:28.148324 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:30.010986 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-67cafc77-406b-474f-88a0-ad6a7f639eeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:32.537241 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:32.565380 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-0b5403c0-d878-4cfe-9209-aaac7d2e0829 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:33.800011 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:35.416604 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:47:51.569757 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:47:58.139726 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:00.016641 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-10862b17-fea2-4604-9b96-4cd6fa330a4c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:02.557045 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:02.587692 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-83d28890-8ab9-4988-9ae2-828dce4d41bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:03.808598 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:05.456147 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:28.170209 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:28.570235 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 28 14:48:30.019129 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-01c82eca-255f-48ea-818f-fda99d14847f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:32.550620 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:32.575603 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-e857682c-1b95-467a-a0a4-ad77914c528a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:33.801854 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:35.450012 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:48:42.259065 dv-cinder-791281-3-iscsi neutron-server[92694]: DEBUG neutron.wsgi [req-7852d83f-1959-462a-9ef0-604edb9a13cf req-1839b0a8-c8ec-4bd8-a78b-0065e34445cd service neutron] (92694) timed out ('10.222.0.59', 39958) {{(pid=92694) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 28 14:48:58.219167 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-31991fd2-b352-4f0a-956a-92059e115fd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:49:00.030137 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-bfcc2c64-e1e2-47f9-a065-7c3873e683bd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:49:02.504298 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-7cae7031-9392-4b3e-9fd4-6f44f22fdf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:49:02.527264 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-b4e5372c-77a4-440e-b585-86e1b2ddcc51 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:49:03.819395 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-f804ca15-11cb-47b2-a876-96c4841741ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:49:05.438397 dv-cinder-791281-3-iscsi neutron-server[92696]: DEBUG neutron_lib.callbacks.manager [None req-15808d55-3c5b-472e-9e88-694591ccbbac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8777742722798', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8325284'] for agent, after_update {{(pid=92696) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 28 14:49:05.569687 dv-cinder-791281-3-iscsi neutron-server[92697]: DEBUG neutron.db.agents_db [None req-eee42aa0-819a-4499-9438-243c7e882bc1 None None] Agent healthcheck: found 6 active agents {{(pid=92697) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}